-- Logs begin at Wed 2022-04-06 09:14:28 UTC, end at Wed 2022-04-06 10:39:11 UTC. -- Apr 06 09:48:05.150748 dv-cinder-836753-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 06 09:48:05.158163 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Apr 6 09:48:05 2022] *** Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: nodename: dv-cinder-836753-1-iscsi Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: machine: x86_64 Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: clock source: unix Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: pcre jit disabled Apr 06 09:48:05.160248 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: detected number of CPU cores: 4 Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: current working directory: / Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: detected binary path: /usr/bin/uwsgi-core Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: your processes number limit is 47680 Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: your memory page size is 4096 bytes Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: detected max file descriptor number: 2048 Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: lock engine: pthread robust mutexes Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: thunder lock: enabled Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 06 09:48:05.160813 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 06 09:48:05.204465 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: Python main interpreter initialized at 0x5568a560e9c0 Apr 06 09:48:05.204465 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: python threads support enabled Apr 06 09:48:05.204465 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: your server socket listen backlog is limited to 100 connections Apr 06 09:48:05.204465 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: your mercy for graceful operations on workers is 90 seconds Apr 06 09:48:05.204871 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: mapped 403077 bytes (393 KB) for 2 cores Apr 06 09:48:05.204951 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: *** Operational MODE: preforking *** Apr 06 09:48:05.205227 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: *** uWSGI is running in multiple interpreter mode *** Apr 06 09:48:05.205227 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: spawned uWSGI master process (pid: 66737) Apr 06 09:48:05.205433 dv-cinder-836753-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 06 09:48:05.206535 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: spawned uWSGI worker 1 (pid: 66751, cores: 1) Apr 06 09:48:05.206535 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: spawned uWSGI worker 2 (pid: 66752, cores: 1) Apr 06 09:48:05.206535 dv-cinder-836753-1-iscsi devstack@keystone.service[66737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 06 09:48:08.085346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 09:48:08.085904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 09:48:08.085904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] command line args: [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 09:48:08.086108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 09:48:08.086489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 09:48:08.086582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 09:48:08.086663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ================================================================================ {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 09:48:08.086663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] admin_token = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.086806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] command line args: [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 09:48:08.086879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] config_dir = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.086954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 09:48:08.087040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ================================================================================ {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 09:48:08.087194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] config_source = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] debug = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] admin_token = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] config_dir = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.087961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] config_source = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] debug = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.088921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_config_append = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_dir = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_file = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_config_append = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.089974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_dir = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_file = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.090960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.091875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.092850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] publish_errors = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.093882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] publish_errors = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.094912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] standard_threads = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] standard_threads = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] use_journal = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.095897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] use_json = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] use_stderr = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] use_syslog = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] use_journal = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] use_json = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.096933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] use_stderr = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.097168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] use_syslog = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.097296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 09:48:08.097535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.097996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.098102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.098201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.098298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.098914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.099971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.100973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.101991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.102950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.103976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.104926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.105898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.106950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.107959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.108943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.109918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.110911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.111986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.112909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.113862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.114005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.117901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.118935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.119954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.external = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.password = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.external = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] auth.token = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.120989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.password = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] auth.token = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.121986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.122953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.123949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.124863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.125009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.125266 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.125503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.125741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.126007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.126285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.126544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.126819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.127881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.128880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.129893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.130923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.131873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.132986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133474 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.133967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.134923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.135950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.136914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.137847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.138968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.139984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.140914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.141918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.142930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.143893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.144972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.145968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.146931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.147900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.148912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.149955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.150062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.150169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.159987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] role.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] role.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.160800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] role.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] role.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.161876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.162997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.163956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.164934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.165910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.166936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.167953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.connection = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.168977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.connection = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.169976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.170984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171345 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 09:48:08.171637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 09:48:08.196362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.196589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.196810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.197482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.197670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.197903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.211435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.211542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.242319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.242502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.242595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.242816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.307714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.307969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.362747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.362980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.363236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.363469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.431551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.431773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.431994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.432805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.433020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.433231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.461389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.461624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.461844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.462904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.463100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.463307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.475168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.483463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.498741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.498959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.499878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.500028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.500115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66752) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.500218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66751) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 09:48:08.517155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.517361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 09:48:08.526512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.526512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 09:48:08.526654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.526654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 09:48:08.526777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.526852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.526929 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 09:48:08.527003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.527378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.529738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.530773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.531051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.539280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.539799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.542487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.542759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.542962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.543062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.543856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.544887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.545061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.545153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.545322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.545579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.571335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.571837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.572869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.573144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.573385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.573657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.578655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.578929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.579147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.579232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.579421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.579695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.586943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.587227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.587312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.587520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.591569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.591813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.591924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.592979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.593154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.593232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.593414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.593516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.593779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.611798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.611906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.612068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.612153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.616546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.616743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.620181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.620364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.620457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.620651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.625356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.625705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.628820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.629228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.632975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.633267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.633366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.639617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.639725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.639840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.639919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.639993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.640080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.640156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.640230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.640230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.653043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.653317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.653521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.653606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.653798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.653881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.654083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.654339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.662182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.662663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.663811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.664079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.664291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.664560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.667014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.667288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.667500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.667612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.667815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.667935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.668046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.668134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.668319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.668585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.682736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.683008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.683206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.683309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.683483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.683568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.683754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.683839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.684846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.702479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.703109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.774430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.775879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.777508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.779050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.779137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.780604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.780763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.780863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.781138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.782449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.782716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.782989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.788376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.792319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.792399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.792399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.792982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.793264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.793541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.793810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.794969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.795251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.795526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.795794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.803172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.803455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.803738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.805065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.805347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.805630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.811459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66751) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.811731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.812006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.812275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.812541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.812811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.813088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.813355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.813491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66752) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 09:48:08.813620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.813772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.813898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.814862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.815015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.815169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66751) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.815295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.815547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.815809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.816069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.816331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.816696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.816958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66752) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 09:48:08.855209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5568a560e9c0 pid: 66752 (default app) Apr 06 09:48:08.856829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x5568a560e9c0 pid: 66751 (default app) Apr 06 09:48:08.858596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c4cb-daa7-4248-bb91-bb5483156f27 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:08.858896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c4cb-daa7-4248-bb91-bb5483156f27 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:08.859184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c4cb-daa7-4248-bb91-bb5483156f27 None None] PATH_INFO: `/v3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:08.863236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 791 bytes} [Wed Apr 6 09:48:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:15.296107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:15.296650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:15.296744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:15.302122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1/2] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:15.307688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:15.308093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:15.308263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:15.349349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG oslo_db.sqlalchemy.engines [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 06 09:48:15.498050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG passlib.handlers.bcrypt [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66752) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Apr 06 09:48:15.498453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG passlib.handlers.bcrypt [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66752) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Apr 06 09:48:15.561721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:15.563306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:15.667979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 2/3] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:48:15.803559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:15.847565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG oslo_db.sqlalchemy.engines [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 06 09:48:15.948152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca8ab6-19b9-4e28-9715-3aad0658d593 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:15.952339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:15.952942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:15.953257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:15.953540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:15.962542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:15.999198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 09:48:15.999542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adde367-65e1-44e9-b03a-fe337952b7a0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:16.009600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 2/4] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:48:16.015502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:16.027070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe712a-c29a-4042-9b62-9e2b96a1d694 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:16.031059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:16.031857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:16.032148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:16.032433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:16.033706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] RBAC: Authorizing `identity:get_project(project_id=243059ad00e449c5acfc061092a4626d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:16.064984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 09:48:16.065329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787be0b-0a6d-4eb5-883a-ffa53c698151 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:16.070386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 3/5] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:16 2022] GET /identity/v3/projects/243059ad00e449c5acfc061092a4626d => generated 344 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:18.042350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bbb2a-b1ba-430f-8c43-fcc0750adafa None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:18.042873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bbb2a-b1ba-430f-8c43-fcc0750adafa None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:18.042958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bbb2a-b1ba-430f-8c43-fcc0750adafa None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:18.047304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 3/6] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:18.053418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:18.053790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:18.054021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:18.077565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:18.079046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:18.086644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 4/7] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:48:18.108215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bbb2a-b1ba-430f-8c43-fcc0750adafa None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:18.119509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bbb2a-b1ba-430f-8c43-fcc0750adafa None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:18.123291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:18.123850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:18.124136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:18.124414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:18.132096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:18.159665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a3052-71ef-409e-8552-44a2563f735d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:18.168538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 4/8] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:48:18.173836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:18.182389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f507a6f-58a5-4823-acc4-ecf48d49dcb5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:18.186320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:18.187107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:18.187399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:18.187678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:18.188906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:18.216270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f053d1-23d6-4054-a190-2583bb79c1ac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:18.217690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 5/9] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:18 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:20.299072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb6c0-3ac7-4467-b4b6-18988ddd918d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.299567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb6c0-3ac7-4467-b4b6-18988ddd918d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.299666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb6c0-3ac7-4467-b4b6-18988ddd918d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.301911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 5/10] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:20.307071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.307454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.307651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.329880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:20.331024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:20.337708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 6/11] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:20.359837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb6c0-3ac7-4467-b4b6-18988ddd918d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:20.371996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb6c0-3ac7-4467-b4b6-18988ddd918d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:20.375862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:20.376573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.376868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.377157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.390480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:20.396917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:20.398043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 6/12] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:20.403548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:20.412155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6cfa5-6d4a-4926-b1f1-6a78f719e37d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:20.416252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:20.416841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.417133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.417421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.418169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:20.418468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:20.443859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:20.443859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:48:20.443859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:48:20.444757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:20.456076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 7/13] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:20.462091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:20.471497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65278-23a0-424b-9bc1-d6daac9dd189 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:20.476238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:20.477013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.477298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.477576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.479085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:20.503667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:20.505258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 7/14] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:20 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:20.510035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:20.519076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ef42-ca10-4730-b215-bd84cc96fcc6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:20.523509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:20.524205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.524495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.524778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.525837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:20.550250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317011a0-2605-4cea-a7d6-5651262724ce admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:20.552297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 8/15] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:20.557400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:20.566439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646fe6-ce2b-4d43-9d3f-5a3dd04ad9b7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:20.570839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:20.571401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:20.571688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:20.571971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:20.572734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.domain.id=default, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:20.573034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:20.597674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:20.597674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:20.597674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:20.599469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0e6a1-882a-4316-9080-33b1238906ab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:20.605921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 8/16] 10.222.0.11 () {56 vars in 1343 bytes} [Wed Apr 6 09:48:20 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.domain.id=default&role.id=2d75a104a2e84475b408c49f7034503e => generated 233 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:22.552769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011e76-1de5-4e3d-a4fd-2f977e7a68f3 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.553323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011e76-1de5-4e3d-a4fd-2f977e7a68f3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.553323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99011e76-1de5-4e3d-a4fd-2f977e7a68f3 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.555297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 9/17] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:22.560306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.560716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.560874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.594107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG passlib.handlers.bcrypt [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66751) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Apr 06 09:48:22.594507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG passlib.handlers.bcrypt [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66751) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Apr 06 09:48:22.642265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:22.643765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:22.651560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 9/18] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:22.673850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99011e76-1de5-4e3d-a4fd-2f977e7a68f3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:22.686136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99011e76-1de5-4e3d-a4fd-2f977e7a68f3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:22.689969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:22.690673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.690963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.691246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.702671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:22.709745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:22.710860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 10/19] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:22.716075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:22.725584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc815321-5aa9-4455-9ecb-b2af25a04c08 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:22.729523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:22.730151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.730440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.730720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.731428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:22.731725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:22.760215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:22.760215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:22.760215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:22.762065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:22.772767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 10/20] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:22.778185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:22.788681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbde6d-1f66-4a42-b196-acf6964c018a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:22.792625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:22.793408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.793697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.794009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.795104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:22.820819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:22.822201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 11/21] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:22 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:22.827317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:22.837259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798b8be-c55e-450c-9aeb-4a177fda1fb4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:22.841169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:22.841863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.842180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.842465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.843531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:22.869193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6577-1f27-4b9d-b84a-31e13474772a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:22.870599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 11/22] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:22.875490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:22.885235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf53e0-8a47-49dd-b412-9450ea306f51 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:22.889149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:22.889910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:22.890229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:22.890516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] PATH_INFO: `/v3/domains/default/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:22.892284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cf57ff3f8bf6405fb95452e508235caa, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:22.916581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:22.916581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:48:22.916581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:48:22.918543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7ffaa-c81f-4306-b8bd-9971a5336041 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:23.194247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 12/23] 10.222.0.11 () {58 vars in 1382 bytes} [Wed Apr 6 09:48:22 2022] PUT /identity/v3/domains/default/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:48:25.150253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e27-ccb1-4fdb-aa07-5bcdf63b73ba None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.150782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e27-ccb1-4fdb-aa07-5bcdf63b73ba None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.150870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e27-ccb1-4fdb-aa07-5bcdf63b73ba None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.152458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 12/24] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 09:48:25.158396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.158810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.158984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.182772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:25.184217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:25.247252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 13/25] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:48:25.268442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203e27-ccb1-4fdb-aa07-5bcdf63b73ba None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:25.280889 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203e27-ccb1-4fdb-aa07-5bcdf63b73ba None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:25.284681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:25.286017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.286311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.286589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.301741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:25.308135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:25.309247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 13/26] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:25.315055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:25.324193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83100-025a-43c3-bd26-235c111bdb24 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:25.328427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:25.329023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.334041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.334041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.334041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:25.334041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:25.356448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:25.367828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 14/27] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:48:25.373134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:25.382888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f12e-0c85-48f2-8987-079c052440de admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:25.386815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:25.387588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.387873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.388152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.389241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:25.414961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:25.416456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 14/28] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:25 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:25.421462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:25.431342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3cb4-a60c-45ec-907f-343018f75b6b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:25.435318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:25.436029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.436324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.436610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.437836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:25.463084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4230f-347f-480f-9161-7b00b2c0514f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:25.464482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 15/29] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:25.469919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:25.479862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef8256-64d9-40cc-a79a-65c4da7307b7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:25.483931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:25.484501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:25.484796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:25.485085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:25.485855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.domain.id=default, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:25.486191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:25.511364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a0b12-a4ab-47cc-8d69-1395f2812bdd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:25.516897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 15/30] 10.222.0.11 () {56 vars in 1343 bytes} [Wed Apr 6 09:48:25 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.domain.id=default&role.id=2d75a104a2e84475b408c49f7034503e => generated 530 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:27.482963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6d91-c6a5-4951-82ad-a35c0c34a528 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:27.483510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6d91-c6a5-4951-82ad-a35c0c34a528 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:27.483510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6d91-c6a5-4951-82ad-a35c0c34a528 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:27.485207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 16/31] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:27.490699 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:27.491111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:27.491272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:27.513886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:27.515059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:27.522561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 16/32] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:27.543240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6d91-c6a5-4951-82ad-a35c0c34a528 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:27.554617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6d91-c6a5-4951-82ad-a35c0c34a528 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:27.558380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:27.558940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:27.559228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:27.559507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:27.567540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:27.592853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a6ae6-9221-4d88-a5c7-55b7c3449ce9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:27.601201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 17/33] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:27 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:48:27.606359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:27.614904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797b41-931a-4e60-bd66-7d37f95a14e0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:27.618853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:27.619565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:27.619856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:27.620141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:27.621195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:27.647339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d168785-4136-4223-89ca-642fad1a18ec admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:27.648754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 17/34] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:29.607924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc896234-6876-4375-899b-51855af70a1c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:29.608444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc896234-6876-4375-899b-51855af70a1c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:29.608556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc896234-6876-4375-899b-51855af70a1c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:29.610290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 18/35] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:29.615685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd808251-3126-413a-a017-da14701d699f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:29.616059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd808251-3126-413a-a017-da14701d699f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:29.616258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd808251-3126-413a-a017-da14701d699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:29.638602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-bd808251-3126-413a-a017-da14701d699f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:29.639728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bd808251-3126-413a-a017-da14701d699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:29.646931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 18/36] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:29.667880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc896234-6876-4375-899b-51855af70a1c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:29.679112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc896234-6876-4375-899b-51855af70a1c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:29.682855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:29.683555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:29.683843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:29.684126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:29.696241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:29.721430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:29.737784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:48:29.738928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 19/37] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:29.744274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd808251-3126-413a-a017-da14701d699f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:29.752788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd808251-3126-413a-a017-da14701d699f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:29.757375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:29.757983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:29.758275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:29.758557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:29.759249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:29.759550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:29.784244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:29.784244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:29.784244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:29.785478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34811eeb-c305-4a9f-a97d-e2f96a17d4a3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:29.801772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 19/38] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:29.806940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:29.815901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b77-aaef-4816-8f75-03f1bc9d98a4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:29.820557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:29.821125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:29.821412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:29.821689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:29.822366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:29.846275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:29.846275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:48:29.846275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:48:29.848040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975b04e-e874-4b2c-a951-90e8b53600e4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:29.943083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 20/39] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:48:29 2022] POST /identity/v3/projects => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:31.919560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccb6c-fd80-4bd0-83e9-69a4b161dab6 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:31.920142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccb6c-fd80-4bd0-83e9-69a4b161dab6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:31.920142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ccb6c-fd80-4bd0-83e9-69a4b161dab6 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:31.921783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 20/40] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:31.927129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f408-b580-4c3a-b93c-03d583003e34 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:31.927502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f408-b580-4c3a-b93c-03d583003e34 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:31.927721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f408-b580-4c3a-b93c-03d583003e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:31.950113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0db6f408-b580-4c3a-b93c-03d583003e34 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:31.951516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0db6f408-b580-4c3a-b93c-03d583003e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:32.019922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 21/41] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:32.042855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ccb6c-fd80-4bd0-83e9-69a4b161dab6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:32.054925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ccb6c-fd80-4bd0-83e9-69a4b161dab6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:32.058787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:32.059375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:32.059669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:32.059956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:32.060651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:32.089924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:32.089924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:32.089924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:32.090861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c80d0a-2ec8-4c4d-8de6-eb27eacf3173 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:32.358235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 21/42] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 09:48:32 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:34.359228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25396c2-ea2b-43e8-94f9-5b08fbfcb69b None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:34.359728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25396c2-ea2b-43e8-94f9-5b08fbfcb69b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:34.359810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25396c2-ea2b-43e8-94f9-5b08fbfcb69b None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:34.361492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 22/43] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:34.367237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9162df-87d8-4071-818d-d9ba020d0f38 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:34.367609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9162df-87d8-4071-818d-d9ba020d0f38 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:34.367826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9162df-87d8-4071-818d-d9ba020d0f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:34.390973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-cb9162df-87d8-4071-818d-d9ba020d0f38 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:34.392426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-cb9162df-87d8-4071-818d-d9ba020d0f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:34.400273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 22/44] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:34.423409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25396c2-ea2b-43e8-94f9-5b08fbfcb69b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:34.435620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25396c2-ea2b-43e8-94f9-5b08fbfcb69b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:34.439509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:34.440096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:34.440390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:34.440677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:34.442011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:34.466177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:34.466177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:48:34.466177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:48:34.467084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f32bb8-462d-4a9e-9129-5109f0b0b0c7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:34.547166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 23/45] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 09:48:34 2022] POST /identity/v3/roles => generated 225 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:36.527872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548446cc-ddc0-4b0a-a1a4-073a4eda4fb9 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:36.528419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548446cc-ddc0-4b0a-a1a4-073a4eda4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:36.528419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548446cc-ddc0-4b0a-a1a4-073a4eda4fb9 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:36.530139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 23/46] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:36.535760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b512e-8001-461e-93dd-250cdbb96cec None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:36.536236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b512e-8001-461e-93dd-250cdbb96cec None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:36.536332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b512e-8001-461e-93dd-250cdbb96cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:36.560239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-901b512e-8001-461e-93dd-250cdbb96cec None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:36.561373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-901b512e-8001-461e-93dd-250cdbb96cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:36.568162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 24/47] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:36.590059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548446cc-ddc0-4b0a-a1a4-073a4eda4fb9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:36.602677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548446cc-ddc0-4b0a-a1a4-073a4eda4fb9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:36.606495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:36.607098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:36.607391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:36.607674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:36.608384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:36.634232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73570e85-590a-46fc-b149-2091cc9926b4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:36.714715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 24/48] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 09:48:36 2022] POST /identity/v3/roles => generated 223 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:48:38.721344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e273b4-23dd-411f-b1e6-d0d35975994d None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:38.722388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e273b4-23dd-411f-b1e6-d0d35975994d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:38.722529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e273b4-23dd-411f-b1e6-d0d35975994d None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:38.724137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 25/49] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:38.729292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:38.729684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:38.729877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:38.752988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:38.754219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:38.760809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 25/50] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:38.782413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e273b4-23dd-411f-b1e6-d0d35975994d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:38.795449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e273b4-23dd-411f-b1e6-d0d35975994d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:38.799661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:38.801684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:38.802015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:38.802412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:38.803740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:38.829087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7bc5-fe75-4d50-b764-e9e17358cc9a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:38.830561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 26/51] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:38.836117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:38.844651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f27ba-d1b2-4d4b-980c-10a82a61a91d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:38.849191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:38.849770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:38.850098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:38.850389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:38.851204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:38.876134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:38.876134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:38.876134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:38.877339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269f82-b759-4bb5-8b9d-51e93524f611 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:38.978102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 26/52] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:48:38 2022] POST /identity/v3/projects => generated 312 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:40.981503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98622fa-4689-498b-a370-fd6af55ea706 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:40.981992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98622fa-4689-498b-a370-fd6af55ea706 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:40.982136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98622fa-4689-498b-a370-fd6af55ea706 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:40.983815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 27/53] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:40.989387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:40.989764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:40.989974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:41.012129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:41.013256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:41.078545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 27/54] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:41.101341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98622fa-4689-498b-a370-fd6af55ea706 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:41.112814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98622fa-4689-498b-a370-fd6af55ea706 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:41.116693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:41.117400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:41.117690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:41.118002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:41.119072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:41.144708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8fba-a8bf-47d1-9356-56a10a52ee22 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:41.146196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 28/55] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:41.151332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:41.159850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97070838-4f0f-46d8-aa59-0912c862dc96 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:41.163841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:41.164425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:41.164716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:41.165000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:41.165648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:41.191925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9e8d1-999d-4fce-86ec-4b3a1ad46ce5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:41.262152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 28/56] 10.222.0.11 () {60 vars in 1161 bytes} [Wed Apr 6 09:48:41 2022] POST /identity/v3/projects => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:43.242333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af80a6-e593-4304-9248-6591b6edc77c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:43.242830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af80a6-e593-4304-9248-6591b6edc77c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:43.242830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af80a6-e593-4304-9248-6591b6edc77c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:43.244518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 29/57] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:43.249604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:43.249986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:43.250226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:43.272791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:43.273909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:43.336349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 29/58] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:43.358833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af80a6-e593-4304-9248-6591b6edc77c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:43.370556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af80a6-e593-4304-9248-6591b6edc77c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:43.374378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:43.375088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:43.375382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:43.375668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:43.376738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:43.402599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1e56-9ff9-423f-916d-d52f37d397c0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:43.404175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 30/59] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:43.409868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:43.418586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1c199-f47a-48d7-96e0-12a12a04dc5d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:43.422543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:43.423139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:43.423436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:43.423723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:43.424380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:43.449600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:43.449600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:43.449600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:43.451102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a350-8287-4e88-8ee2-1f8a99c7d868 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:43.553743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 30/60] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:48:43 2022] POST /identity/v3/users => generated 275 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:48:45.561359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71adc-28d3-46b5-a2c6-809452326b2c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.561875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71adc-28d3-46b5-a2c6-809452326b2c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.561987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71adc-28d3-46b5-a2c6-809452326b2c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.563629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 31/61] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:45.569426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.569845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.570035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.592548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:45.593678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:45.600395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 31/62] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:45.622462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71adc-28d3-46b5-a2c6-809452326b2c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.634570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71adc-28d3-46b5-a2c6-809452326b2c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.638400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.639110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.639402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.639689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.651365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:45.657755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:48:45.658874 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 32/63] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:45.664196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.672573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892682b0-ca16-4184-8b11-837ecc6bee6e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.677109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.677692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.678018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.678306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.679021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:45.679324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:45.704309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:45.713410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 32/64] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:45.718535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.729470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57ed82-a45b-406a-b946-7de158b15445 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.733378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.734203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.734494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.734775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.753408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:45.788708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:45.790816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 33/65] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:45.796110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.809605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7779fb-762d-441a-b42a-c1be0e13abe9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.815067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.815902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.816196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.816483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.824414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:45.851082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:45.859505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 33/66] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:48:45.865170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.874403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4237d-7108-40b9-b28d-9519fe49491b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.878561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.879346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.879641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.879928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.881026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:45.906640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d226bd-df9e-4643-967a-c68e8449ffba admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:45.908157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 34/67] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:45.914075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:45.922298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231cdcc-cfac-49ea-887e-31892bcdcbd1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:45.926282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:45.926875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:45.927165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:45.927447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:45.928214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:45.928516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:45.953772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a598fa-163d-48da-8e2b-f6bce2e4a65b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:45.959572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 34/68] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:48:45 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:47.897489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a10d-02ae-4b39-8495-6b6780915f88 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:47.898028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a10d-02ae-4b39-8495-6b6780915f88 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:47.898143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a10d-02ae-4b39-8495-6b6780915f88 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:47.899866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 35/69] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:47.904978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:47.905374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:47.905560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:47.928720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:47.929858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:47.936608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 35/70] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:47.958864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a10d-02ae-4b39-8495-6b6780915f88 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:47.970380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a10d-02ae-4b39-8495-6b6780915f88 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:47.974999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:47.975713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:47.977533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:47.977533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:47.987612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:47.994101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:48:47.995191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 36/71] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:48.000716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:48.009887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e917f-55de-4952-a05c-7c23b0a51264 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:48.013987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:48.014678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:48.014975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:48.015264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:48.015984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:48.016291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:48.042389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:48.050993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 36/72] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:48:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:48.056411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:48.066447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73a744-c7f6-4821-9669-3d18abb528e3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:48.070339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:48.071118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:48.071405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:48.071686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:48.072771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:48.102327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:48.103899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 37/73] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:48 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:48.109679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:48.119203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bc1e7-e53b-41bc-ab4d-15a4206d1915 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:48.123223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:48.124012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:48.124305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:48.124593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:48.125729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:48.156737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9180c4d-9f67-4d47-aab5-0a85538d95a5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:48.158334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 37/74] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:48 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:48.164791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:48.174091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0adee-1333-466e-9d0b-251cd7319e95 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:48.178029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:48.178832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:48.179119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:48.179400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/eb0548be2b5b414793600ed4b598db29/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:48.181129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8792ac1fff2499693ec24addb914ca7, user_id=eb0548be2b5b414793600ed4b598db29, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:48.207454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f235b-d562-43df-b6de-0a120d434c3e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:48.272694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 38/75] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:48:48 2022] PUT /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/eb0548be2b5b414793600ed4b598db29/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:48:50.242423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a31d-7b8a-4882-9821-47357dee98ff None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.242946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a31d-7b8a-4882-9821-47357dee98ff None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.242946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a31d-7b8a-4882-9821-47357dee98ff None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.244601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 38/76] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:50.249585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.250021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.250185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.272633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:50.273756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:50.336316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 39/77] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:50.358336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a31d-7b8a-4882-9821-47357dee98ff None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.370312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a31d-7b8a-4882-9821-47357dee98ff None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.374048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.374760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.375050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.375330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.388731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:50.395975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:48:50.397045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 39/78] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:50.402440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.411500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82f0d-9164-4cce-b5bd-a23207f2cab3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.415468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.416064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.416359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.416645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.417363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:50.417666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:50.442370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:50.450999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 40/79] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:50.457129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.466141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3673-7f22-46a5-9064-c72d359d51b9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.470000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.470779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.471065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.472369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.473655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:50.499340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:50.500709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 40/80] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:48:50.505815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.514781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9842-7313-4d11-93c9-24d331238245 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.519710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.520267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.520559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.520845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.528358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:50.554089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:50.562388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 41/81] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:48:50.568394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.577465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d2b56-b768-45cb-8ffb-74a4c40ccf34 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.581985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.582747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.583034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.583314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.584362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:50.610252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df71912-9e72-4d4e-bf3d-01993effc963 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:50.611730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 41/82] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:50.617432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:50.625664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacaa2dd-09c8-4d00-b4b1-a4665581ff69 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:50.629825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:50.630415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:50.630708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:50.630993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:50.631749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:50.632057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:50.655924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:50.655924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:48:50.655924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:48:50.657067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3d8a7-ef6a-4643-9f70-835a3941212c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:50.663364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 42/83] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:48:50 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:52.653917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f59d-3857-428a-a426-125fab147cf5 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.654506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f59d-3857-428a-a426-125fab147cf5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.654506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9f59d-3857-428a-a426-125fab147cf5 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.656181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 42/84] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:52.661283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.661669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.661856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.684258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:52.685418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:52.692893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 43/85] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:48:52.714873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f59d-3857-428a-a426-125fab147cf5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.726284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9f59d-3857-428a-a426-125fab147cf5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.730158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.730869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.731162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.731445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.743611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:52.749868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:52.750952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 43/86] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:52.757022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.765382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137966d0-6eab-4db3-9a64-7a3e14dcfeb0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.769510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.770134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.770432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.770721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.771435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:52.771741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:52.797577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:52.807066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 44/87] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:52.812488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.822525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679b1b-13d5-458e-a684-b033a9a017c1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.826740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.827523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.827816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.828102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.829177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:52.854798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:52.856234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 44/88] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:52.861247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.870940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee2b5-5773-413e-9e8c-0269e0339b77 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.874852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.875419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.875713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.876000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.884119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:52.909219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:52.917401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 45/89] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:48:52.922702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.931739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43091d2-d39d-488a-a7b1-dbb9957990d6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.935650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.936417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.936712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.937000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.938124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:52.964853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3816c-7919-4df3-a5e0-6ed5861ce2af admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:52.966551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 45/90] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:52.972038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:52.980568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbba759-05fd-42bd-ae7a-27d7689ed873 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:52.984556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:52.985134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:52.985429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:52.985716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:52.986528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:52.986876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:53.012691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc220-6ab9-44b7-acfb-4ee014020e5f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:53.017996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 46/91] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:48:52 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:54.955923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9609-ac20-48fc-8d9e-41c403cd508f None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:54.956473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9609-ac20-48fc-8d9e-41c403cd508f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:54.956559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9609-ac20-48fc-8d9e-41c403cd508f None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:54.958188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 46/92] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:54.963395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:54.963797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:54.963976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:54.985758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:54.987420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:54.993982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 47/93] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:55.016216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c9609-ac20-48fc-8d9e-41c403cd508f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:55.027965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c9609-ac20-48fc-8d9e-41c403cd508f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:55.033286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:55.034168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:55.034405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:55.034692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:55.050636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:55.057017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:55.058143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 47/94] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:48:55.063850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:55.073035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df466c-7c1d-4605-a2fb-d9766f8acb7a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:55.077199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:55.077789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:55.078120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:55.078407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:55.079118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:55.079423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:55.104991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:55.114121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 48/95] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:55.119308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:55.129296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f6fc-ac0a-4dd9-8954-5b0b633f4dd9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:55.133281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:55.134099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:55.134398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:55.134689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:55.135769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:55.161401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:55.162883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 48/96] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:55 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:55.167856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:55.177663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe892a-700e-4688-89d2-415609dc41d0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:55.181575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:55.182378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:55.182674 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:55.182960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:55.184033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:55.209515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06806-3005-4e84-b7b7-7c540f5c26ac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:55.211008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 49/97] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:55 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:55.215909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:55.225407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647f352-35b2-4be2-aeb9-5c58a909b4d7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:55.229235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:55.230061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:55.230355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:55.230641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:55.232359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8792ac1fff2499693ec24addb914ca7, user_id=cf57ff3f8bf6405fb95452e508235caa, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:55.257052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:48:55.257052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:48:55.257052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:48:55.259014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56daa2a-ca77-4f3b-8803-d76febda1b5c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:55.345318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 49/98] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:48:55 2022] PUT /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:48:57.280881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbcf0-42e4-4b2f-b429-7e175afa5054 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.281385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbcf0-42e4-4b2f-b429-7e175afa5054 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.281385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbcf0-42e4-4b2f-b429-7e175afa5054 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.283099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 50/99] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:57.288183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.288561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.288761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.311077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:57.312201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:57.375193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 50/100] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:57.397336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cbcf0-42e4-4b2f-b429-7e175afa5054 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.409253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cbcf0-42e4-4b2f-b429-7e175afa5054 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.413147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.413853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.414191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.420037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.426693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:57.433015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:48:57.434102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 51/101] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:57.439769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.448265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886822b-1e6e-4934-b07d-23e29cf46244 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.452407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.452999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.453293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.453579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.454329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:57.454856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:57.480260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:57.489375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 51/102] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:57.494637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.503850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49606146-da61-4a57-8f21-5145f2a93a1f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.507720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.508493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.508778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.509055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.510145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:57.535690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:57.537110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 52/103] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:57.542296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.552338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535852-014d-4d5d-aa49-bc6451f5b05f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.556180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.556741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.557030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.557315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.565197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:57.590700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:57.599856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 52/104] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:48:57.604963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.614613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae3c0-05a8-4cd6-b504-a8a0bbca2041 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.618423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.619179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.619466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.619746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.620794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:57.645899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b9d8b-f80c-4afe-8970-83b5497a91a3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:57.647389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 53/105] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:57.652571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:57.661631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23da006-8926-406a-94f4-8027dc60ae39 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:57.665561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:57.666153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:57.666442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:57.666723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:57.667486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:57.667789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:57.693652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40770cd1-83e3-4eb9-9292-14d221fc92f6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:57.699246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 53/106] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:48:57 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:59.691306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687aeb-6f93-4bff-9030-ae80f0f176a2 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.691817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687aeb-6f93-4bff-9030-ae80f0f176a2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.691935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf687aeb-6f93-4bff-9030-ae80f0f176a2 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.693545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 54/107] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:48:59.698652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.699059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.699253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.721902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:48:59.723052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:48:59.729605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 54/108] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:48:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:48:59.750666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687aeb-6f93-4bff-9030-ae80f0f176a2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:59.762559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf687aeb-6f93-4bff-9030-ae80f0f176a2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:59.766311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:59.767015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.767301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.767586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.779382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:48:59.786154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:48:59.787209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 55/109] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:48:59.792462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:59.801000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262940f-2893-4cec-8cf5-e6d74d411eb2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:59.804854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:59.805438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.805748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.806051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.806761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:48:59.807064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:59.833691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:59.841864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 55/110] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:48:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:59.847027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:59.857018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcb373-48ea-49f0-a81f-d9a8d2d54ee7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:59.860907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:59.861788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.862114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.862403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.863487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:59.889176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:59.890645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 56/111] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:48:59 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:48:59.896161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:59.905028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c866-e4d7-4d9d-bcfe-a04fbb9fed1d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:59.909027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:59.909581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.909875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.910190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.917598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:59.943668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:48:59.952183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 56/112] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:48:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:48:59.957501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:48:59.966718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef674f-adab-4651-9045-0028bf74e19d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:48:59.970600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:48:59.971410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:48:59.971700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:48:59.971984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:48:59.973119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:48:59.998673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e295-7b01-4d84-bd61-5edea1c7ceac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:00.000189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 57/113] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:48:59 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:00.006295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:00.014820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17320-62b8-49e5-a2be-deeca8272d82 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:00.018874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:00.019452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:00.019746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:00.020035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:00.020814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:00.021121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:00.046178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aad41f-a02a-4c85-9c0d-95dbde5eba92 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:00.051932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 57/114] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:00 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:02.018944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a075de-2652-4a39-a8c0-4a1bf3e4b5e2 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.019398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a075de-2652-4a39-a8c0-4a1bf3e4b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.019523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a075de-2652-4a39-a8c0-4a1bf3e4b5e2 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.021226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 58/115] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:02.026164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.026555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.026742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.050609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:02.051764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:02.058453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 58/116] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:02.081667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a075de-2652-4a39-a8c0-4a1bf3e4b5e2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:02.093271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a075de-2652-4a39-a8c0-4a1bf3e4b5e2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:02.097756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:02.098515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.098810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.099097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.110147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:02.117528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:02.118626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 59/117] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:02.124015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:02.132727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee195a3-3da6-449d-8fe6-ca66d142574d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:02.136551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:02.137135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.137425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.137708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.138451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:02.138752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:02.164090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:02.172174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 59/118] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:02.178440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:02.188304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98db3b-4ec9-4a07-bf20-e7128ad6fc8b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:02.192564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:02.193337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.193626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.193907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.196947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:02.225072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:02.226591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 60/119] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:02 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:02.232072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:02.241196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac108292-f061-4e70-863f-cdcae5340d68 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:02.245067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:02.245839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.246155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.246436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.247501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:02.273317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17db59-c92e-485d-b179-27a149339bba admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:02.274834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 60/120] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:02 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:02.279892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:02.290059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37093-fa05-42fb-bd6d-82155151ecbb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:02.293863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:02.294684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:02.294972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:02.295254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/eb0548be2b5b414793600ed4b598db29/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:02.297160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8792ac1fff2499693ec24addb914ca7, user_id=eb0548be2b5b414793600ed4b598db29, role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:02.323508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209800e9-91ac-4fda-9edd-83bef687bad3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:02.391652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 61/121] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:49:02 2022] PUT /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7/users/eb0548be2b5b414793600ed4b598db29/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:49:04.377694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be949-a53f-4a64-b250-894aa5cf2060 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.378252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be949-a53f-4a64-b250-894aa5cf2060 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.378340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be949-a53f-4a64-b250-894aa5cf2060 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.379978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 61/122] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:04.384955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.385361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.385536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.409222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:04.410390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:04.473253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 62/123] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:04.494702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be949-a53f-4a64-b250-894aa5cf2060 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.506136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be949-a53f-4a64-b250-894aa5cf2060 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.509862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.510632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.510923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.511205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.523559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:04.530248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:04.531324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 62/124] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:04.537186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.545522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d5af1-72f1-4360-8a6f-c676d72c7976 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.549526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.550146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.550435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.550717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.551417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:04.551716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:04.576949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:04.585665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 63/125] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:04.590721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.600773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060486-f2c5-437b-af08-09a64919365a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.604589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.605363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.605654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.605963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.607037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:04.633134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:04.634539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 63/126] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:04.639387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.648837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b838e-bc79-4efb-8933-0537e61d3814 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.652671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.653224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.653518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.653800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.661326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:04.686213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:04.694869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 64/127] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:04.700307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.709391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12654c0-10d4-41e4-830a-8495893766c2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.713234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.714021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.714315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.714598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.715664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:04.741643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820d29-63ce-4bd8-bb9f-80837514a2fb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:04.743147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 64/128] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:04.748309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:04.757095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb727-9d3d-4d83-b4b9-922512b7cad1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:04.760910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:04.761472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:04.761757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:04.762074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:04.762834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=c8792ac1fff2499693ec24addb914ca7, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:04.763136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:04.788174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29888-9a1f-41ec-881a-993721226e42 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:04.793919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 65/129] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:04 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:06.787173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edbe66-23d5-4235-b37c-b4835058bf41 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:06.787687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edbe66-23d5-4235-b37c-b4835058bf41 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:06.787770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edbe66-23d5-4235-b37c-b4835058bf41 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:06.789410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 65/130] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:06.794585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:06.795021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:06.795156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:06.818743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:06.819862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:06.826565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 66/131] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:06.847921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edbe66-23d5-4235-b37c-b4835058bf41 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:06.859174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edbe66-23d5-4235-b37c-b4835058bf41 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:06.863690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:06.864397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:06.864690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:06.864978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:06.875938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:06.883116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:06.884174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 66/132] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:06.889380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:06.897854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b83c-0b98-4c12-82c0-35183d7a12f9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:06.901706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:06.902327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:06.902620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:06.902904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:06.903614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:06.903912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:06.929054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:06.937415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 67/133] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:06.943278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:06.953516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca6b27-b5b0-4930-8dda-7d202a076baa admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:06.957615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:06.958428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:06.958723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:06.959010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:06.960093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:06.985346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:06.987470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 67/134] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:06 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:06.992679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:07.002913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c87490-43ca-4a47-a244-5b074570fa87 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:07.006840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:07.007710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:07.008008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:07.008291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:07.015842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:07.040680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:07.049503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 68/135] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:07.054731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:07.063745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535987-a6ac-440f-b231-828d05ca746f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:07.068458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:07.069225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:07.069520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:07.069807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] PATH_INFO: `/v3/projects/ef5c414ee7ba4731b0ab94c015a31761` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:07.070910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5c414ee7ba4731b0ab94c015a31761)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:07.097069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a48aa-06fb-46e3-a80b-47aaa8393277 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:07.098573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 68/136] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:07 2022] GET /identity/v3/projects/ef5c414ee7ba4731b0ab94c015a31761 => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:07.103860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:07.113239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3f91-ec29-4fd3-98ca-888e51ab8ed5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:07.117202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:07.117768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:07.118099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:07.118387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:07.119157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=ef5c414ee7ba4731b0ab94c015a31761, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:07.119465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:07.144609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9204b7-79e6-4202-b919-0f440fcc937a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:07.150055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 69/137] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:07 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=ef5c414ee7ba4731b0ab94c015a31761&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:09.081235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13073f7b-7302-47fc-8ad9-a70e40bb48c3 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.081764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13073f7b-7302-47fc-8ad9-a70e40bb48c3 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.081853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13073f7b-7302-47fc-8ad9-a70e40bb48c3 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.083477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 69/138] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:09.088407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.088816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.088983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.111607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:09.112752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:09.119504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 70/139] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:09.141079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13073f7b-7302-47fc-8ad9-a70e40bb48c3 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:09.153114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13073f7b-7302-47fc-8ad9-a70e40bb48c3 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:09.157067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:09.158355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.158751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.159050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.170028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:09.176384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:09.177451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 70/140] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:09.182917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:09.191346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb94d7-929b-4989-83d3-951997165f97 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:09.195201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:09.195788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.196081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.196367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.197072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:09.197374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:09.223244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:09.231635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 71/141] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:09.236804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:09.246679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad0d0-ab5f-436e-9e0a-f12aa879cfa6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:09.250558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:09.251327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.251732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.252093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.253165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:09.279117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:09.280531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 71/142] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:09 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:09.285602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:09.294557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59be43-a5e8-46d4-9388-17b3a41f927a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:09.299098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:09.299787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.300070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.300347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] PATH_INFO: `/v3/projects/ef5c414ee7ba4731b0ab94c015a31761` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.302554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5c414ee7ba4731b0ab94c015a31761)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:09.328238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bf3a0-2b5b-444f-840f-9c509cb3172d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:09.329908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 72/143] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:09 2022] GET /identity/v3/projects/ef5c414ee7ba4731b0ab94c015a31761 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:09.335043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:09.344010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d264-0ce9-4ee1-9443-390ff4516a4a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:09.348553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:09.349348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:09.349641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:09.349945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] PATH_INFO: `/v3/projects/ef5c414ee7ba4731b0ab94c015a31761/users/eb0548be2b5b414793600ed4b598db29/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:09.351677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5c414ee7ba4731b0ab94c015a31761, user_id=eb0548be2b5b414793600ed4b598db29, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:09.378570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f7f3-4f20-43eb-855b-931099e6f346 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:09.465772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 72/144] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:49:09 2022] PUT /identity/v3/projects/ef5c414ee7ba4731b0ab94c015a31761/users/eb0548be2b5b414793600ed4b598db29/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:49:11.409512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d158-caaa-45e4-bf97-efb0dc1665f9 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.410053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d158-caaa-45e4-bf97-efb0dc1665f9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.410136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d158-caaa-45e4-bf97-efb0dc1665f9 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.411819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 73/145] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:11.416925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.417340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.417506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.440607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:11.441713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:11.505940 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 73/146] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:11.527683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d158-caaa-45e4-bf97-efb0dc1665f9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.539526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d158-caaa-45e4-bf97-efb0dc1665f9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.543297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.544001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.544291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.544574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.557187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:11.563419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:11.565340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 74/147] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:11.570722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.579264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73ef0b-5638-4252-b245-6232b353b86a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.583093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.583682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.583971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.584254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.584985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:11.585286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:11.610568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:11.619360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 74/148] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:11.624443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.633872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4240-e179-4a1b-8c1c-0492d60f7e70 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.637714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.638516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.638805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.639088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.640150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:11.667127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:11.668495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 75/149] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:11.674189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.683249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11239f8-4ef1-42f2-89bc-65fc3e5dc4a6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.687174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.687736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.688028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.688316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.696030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:11.721921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:11.730159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 75/150] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:11.735182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.744852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a5c42-95ec-46f6-bae3-89067c893d26 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.748747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.749506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.749827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.750153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] PATH_INFO: `/v3/projects/ef5c414ee7ba4731b0ab94c015a31761` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.751241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5c414ee7ba4731b0ab94c015a31761)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:11.776455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bfe00-db70-49f1-a6ff-71d0d94a798e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:11.777960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 76/151] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/projects/ef5c414ee7ba4731b0ab94c015a31761 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:11.783701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:11.791899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8e809-e5fc-48c7-8053-be34d93689d5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:11.795815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:11.796373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:11.796665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:11.796950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:11.797715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=ef5c414ee7ba4731b0ab94c015a31761, user.id=eb0548be2b5b414793600ed4b598db29) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:11.798055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:11.823679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee7b2c-0cb3-4289-9180-342afd2816c3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:11.830084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 76/152] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:11 2022] GET /identity/v3/role_assignments?user.id=eb0548be2b5b414793600ed4b598db29&scope.project.id=ef5c414ee7ba4731b0ab94c015a31761&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:13.823716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627fd13-707e-434c-93e8-65be196b95b2 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:13.824520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627fd13-707e-434c-93e8-65be196b95b2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:13.824609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627fd13-707e-434c-93e8-65be196b95b2 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:13.826263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 77/153] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:13.831435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:13.831845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:13.832017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:13.854312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:13.855456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:13.862857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 77/154] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:49:13.884613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627fd13-707e-434c-93e8-65be196b95b2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:13.896031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627fd13-707e-434c-93e8-65be196b95b2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:13.899847 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:13.900548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:13.900843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:13.901130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:13.902217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:13.928216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390aa04-3d96-4159-973e-c4f6c43c0fc1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:13.929657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 78/155] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:13.934796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:13.943345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9ac2-11e8-4ad2-b0e2-9978a26e1c10 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:13.947186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:13.947762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:13.948051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:13.948328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:13.948971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:13.974797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce27e3-f6bc-4d9f-9e7a-82ef44166c87 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:14.119734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 78/156] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:49:13 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:49:16.095715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3ba-3e33-4663-b819-59f9c265c97e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:16.096234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3ba-3e33-4663-b819-59f9c265c97e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:16.096318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3ba-3e33-4663-b819-59f9c265c97e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:16.097961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 79/157] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:16.103104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:16.103528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:16.103680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:16.126975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:16.128119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:16.194205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 79/158] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:16.217041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853c3ba-3e33-4663-b819-59f9c265c97e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:16.228991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853c3ba-3e33-4663-b819-59f9c265c97e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:16.232720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:16.233434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:16.233720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:16.234029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:16.235063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:16.260378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443ded0-658f-491f-8426-e91ccf88f729 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:16.261853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 80/159] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:16.267193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:16.275750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841481e-f1de-4481-8ea0-a002f57f4d8f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:16.279666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:16.280254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:16.280542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:16.280819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:16.281468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:16.307773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ddac9-3956-4c70-9d97-7508fd0a2fee admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:16.397538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 80/160] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:49:16 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:49:18.406649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b4bc-7f67-46d9-8a0c-2363ddbf401e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.407167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b4bc-7f67-46d9-8a0c-2363ddbf401e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.407785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22b4bc-7f67-46d9-8a0c-2363ddbf401e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.409866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 81/161] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:18.415038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.415428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.415611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.438986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:18.440539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:18.449755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 81/162] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:18.477911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b4bc-7f67-46d9-8a0c-2363ddbf401e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.490259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22b4bc-7f67-46d9-8a0c-2363ddbf401e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.494137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.494848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.495139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.495427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.507503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:18.513878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:18.514977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 82/163] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:18.520649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.529116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a18ac-b2a0-497e-b02c-7278af92426e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.533565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.534176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.534466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.534748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.535455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:18.535755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:18.561210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:18.569722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 82/164] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:18.575123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.584281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba83b-6772-4595-bd9b-74308dbf25d6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.588264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.589034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.589322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.589605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.608086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:18.633782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:18.635283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 83/165] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:18.640625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.649856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cae2f-6741-4289-bc04-288ec5e7838a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.653762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.654401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.654695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.654988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.663391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:18.689247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:18.697508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 83/166] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:18.703051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.713002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce96b5-d6dc-4c2e-bbdf-f731362f26d3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.716842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.717601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.717884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.718221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.719270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:18.745733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325985df-c815-4844-9e52-8a172cf34418 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:18.747235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 84/167] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:18.752733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:18.761920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b2029-26f4-49d0-bb80-35493b1f7fb5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:18.768411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:18.769892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:18.769892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:18.769892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:18.770370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=50654ae35136436d96531de099d2b865) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:18.770678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:18.796645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258a82c-dbbf-4dda-9f18-d3c32e4033bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:18.802395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 84/168] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:18 2022] GET /identity/v3/role_assignments?user.id=50654ae35136436d96531de099d2b865&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:20.724082 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9a11-286c-4fa7-884f-274da0c5ad6f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.724654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9a11-286c-4fa7-884f-274da0c5ad6f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.724654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9a11-286c-4fa7-884f-274da0c5ad6f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.726371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 85/169] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:20.731270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443761-650d-4d18-9876-a7896012ee95 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.731684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443761-650d-4d18-9876-a7896012ee95 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.731841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443761-650d-4d18-9876-a7896012ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.754975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-03443761-650d-4d18-9876-a7896012ee95 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:20.756099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-03443761-650d-4d18-9876-a7896012ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:20.762776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 85/170] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:20.784765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9a11-286c-4fa7-884f-274da0c5ad6f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:20.796129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9a11-286c-4fa7-884f-274da0c5ad6f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:20.800073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:20.800772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.801060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.801343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.812290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:20.819131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:20.820187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 86/171] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:20.825707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443761-650d-4d18-9876-a7896012ee95 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:20.834145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443761-650d-4d18-9876-a7896012ee95 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:20.838018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:20.838601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.838888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.839168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.839870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:20.840167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:20.866279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:20.874540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 86/172] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:20.879813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:20.889734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496113bd-cee6-4ab0-b010-a6eea19e501f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:20.893664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:20.894457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.894745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.895026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.896088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:20.921594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:20.923623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 87/173] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:20 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:20.928679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:20.937547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4430-0d2b-4978-8310-c64a20c797fa admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:20.941472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:20.942260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.942543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.942817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.943880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:20.970314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98816ea-6981-4d68-a4b1-a9bc05d78a92 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:20.971827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 87/174] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:20 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:20.977063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:20.986377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad89d86-bec7-48c3-8e15-62858016c59d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:20.990278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:20.991074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:20.991361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:20.991638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/50654ae35136436d96531de099d2b865/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:20.993365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c06c5abccc4ef5a867d99a20b4dd18, user_id=50654ae35136436d96531de099d2b865, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:21.019424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49015da0-6fdc-42c8-b776-f3f9f4a5ac8b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:21.115195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 88/175] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:49:20 2022] PUT /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/50654ae35136436d96531de099d2b865/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:49:23.164870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6810-0652-4183-99e1-f555b381cd0a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.165379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6810-0652-4183-99e1-f555b381cd0a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.165494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6810-0652-4183-99e1-f555b381cd0a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.167125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 88/176] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:23.172222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.172713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.172867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.195109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:23.196216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:23.258576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 89/177] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:49:23.280824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b6810-0652-4183-99e1-f555b381cd0a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.292641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b6810-0652-4183-99e1-f555b381cd0a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.296456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.297162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.297446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.297728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.309471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:23.315972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:23.317028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 89/178] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:49:23.322407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.331569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d033601-8773-466e-aa40-52b51b6330dc None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.335498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.336085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.336375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.336658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.337365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:23.337665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:23.362986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:23.371337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 90/179] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:23.376408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.385403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3b09-4b18-4d86-ade3-ef7e6e624599 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.389398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.390219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.390508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.390787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.392572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:23.418762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:23.420223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 90/180] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:23.425295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.434484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d40f4-5dc9-4004-bb70-f3a0452fe0a4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.438425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.438995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.439280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.439561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.448400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:23.476452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:23.485049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 91/181] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:23.490574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.499622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2fa2-403a-4880-8405-30efd22f1547 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.503681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.504447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.504735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.505014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.506115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:23.531995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d691f-978a-4839-b78f-a355b8bd87c4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:23.534352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 91/182] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:23.539603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:23.547959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f580ce-bb0c-4bee-863a-17b593ad3c28 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:23.554031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:23.554600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:23.554883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:23.555161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:23.555924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] RBAC: Adding query filter params (role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=50654ae35136436d96531de099d2b865) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:23.556224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:23.583111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9f12-8291-438c-a2db-7c21ff72df76 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:23.588689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 92/183] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:23 2022] GET /identity/v3/role_assignments?user.id=50654ae35136436d96531de099d2b865&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:25.587882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033983de-e2ab-4224-90db-3c29472d85c7 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.588422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033983de-e2ab-4224-90db-3c29472d85c7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.588422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033983de-e2ab-4224-90db-3c29472d85c7 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.590139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 92/184] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:25.595819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.596179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.596386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.619534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:25.620658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:25.627242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 93/185] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:25.649357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033983de-e2ab-4224-90db-3c29472d85c7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.660988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033983de-e2ab-4224-90db-3c29472d85c7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.664766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.665468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.665754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.666066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.677657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:25.685493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:49:25.686640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 93/186] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:49:25.692892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.701769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6858dd-356e-478a-828f-8b279edba63d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.705755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.706375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.706664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.706944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.707649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:25.707947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:25.732581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:25.741406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 94/187] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:25.746792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.757507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac710e-aaf6-46c1-9a5a-0e9572ccc1dd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.761387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.762192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.762478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.762755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.763822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:25.788711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:25.790233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 94/188] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:25.795166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.804683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5170f1-36f9-4326-a5b9-6a95b2069bcd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.808496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.809053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.809339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.809621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.817875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:25.842880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:25.851521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 95/189] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:25.856720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.866336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc6151-7256-40d5-985d-961489a8e0e2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.870160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.870910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.871195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.871475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.872533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:25.901320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a976c-9ecc-45b7-a456-989ebd11c569 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:25.902845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 95/190] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:25.909048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:25.917301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918e8ce-4a27-427a-889d-7544a4aaac45 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:25.921133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:25.921696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:25.922012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:25.922292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:25.923647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:25.923948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:25.948955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075807fd-b064-4931-a50c-a880eb805461 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:25.954570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 96/191] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:25 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:27.904522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ded6f-49b9-444b-a656-95a8596491dd None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:27.905065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ded6f-49b9-444b-a656-95a8596491dd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:27.905065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ded6f-49b9-444b-a656-95a8596491dd None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:27.906839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 96/192] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:27.912367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:27.912785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:27.912933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:27.934910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:27.936025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:27.942770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 97/193] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:27.964437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ded6f-49b9-444b-a656-95a8596491dd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:27.978437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ded6f-49b9-444b-a656-95a8596491dd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:27.988956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:27.988956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:27.988956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:27.988956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:27.994886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:28.001543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:49:28.002759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 97/194] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:28.009119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:28.018359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf13511-8b4c-4fa6-a146-732ef0eedb9e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:28.022188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:28.022773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:28.023059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:28.023338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:28.024034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:28.024328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:28.049771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:28.058093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 98/195] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:28.063985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:28.074483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33e7b5-3983-43ad-9c09-6815a73196df admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:28.078361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:28.079855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:28.080147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:28.080431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:28.081514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:28.106567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:28.108002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 98/196] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:28 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:28.112999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:28.121830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c89365-7785-4bd1-9429-63064c58fac5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:28.126170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:28.126879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:28.127161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:28.127437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:28.128481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:28.154098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4dd05-e7b2-4f6e-9139-95c9a9dd3146 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:28.155618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 99/197] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:28 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:28.161097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:28.170001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c230f7-1b63-4088-8644-aa7887c2f8de admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:28.174328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:28.175119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:28.175404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:28.175682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:28.177388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c06c5abccc4ef5a867d99a20b4dd18, user_id=cf57ff3f8bf6405fb95452e508235caa, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:28.205350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d8ccc-7bf1-4297-ab44-dfe1eb852398 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:28.298086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 99/198] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:49:28 2022] PUT /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/cf57ff3f8bf6405fb95452e508235caa/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:49:30.240532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e451d9-6c08-4187-b071-4f5d139311d9 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.241019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e451d9-6c08-4187-b071-4f5d139311d9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.241019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e451d9-6c08-4187-b071-4f5d139311d9 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.242719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 100/199] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:30.247798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.248181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.248370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.272405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:30.273531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:30.336928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 100/200] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:30.359766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e451d9-6c08-4187-b071-4f5d139311d9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.371719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e451d9-6c08-4187-b071-4f5d139311d9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.375539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.376246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.376532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.376814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.388398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:30.394822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:49:30.395886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 101/201] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:30.401346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.410446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9976-3f53-4abf-a385-0f363bf0daa8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.414326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.414915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.415209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.415492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.416201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:30.416501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:30.442059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:30.450642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 101/202] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:30.456400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.465352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fec68-b925-4230-b8ae-17039ab9fc0f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.469160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.470111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.470401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.470678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.471745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:30.496564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:30.497956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 102/203] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:30.503527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.512411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4ab3-1b7c-4434-afda-763f4d696c05 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.516841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.517529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.517818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.518130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.525500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:30.550736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:30.558928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 102/204] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:30.564716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.573911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4cee0-74da-48d9-92e5-3a712905a8d2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.577731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.579120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.579412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.579695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.580746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:30.605677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d689e1-11dc-45e8-9788-c208ffff55fb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:30.607175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 103/205] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:30.612351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:30.620421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7e28-5f5f-4b0e-be7f-2efd9dae61a2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:30.624225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:30.624777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:30.625062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:30.625849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:30.626713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=cf57ff3f8bf6405fb95452e508235caa) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:30.627014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:30.651963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3023c7e-c2c5-43eb-a007-ad59a540c306 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:30.658232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 103/206] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:30 2022] GET /identity/v3/role_assignments?user.id=cf57ff3f8bf6405fb95452e508235caa&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:32.652514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233a8e-0d50-478c-9a2b-3df9cc399bd6 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.653037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233a8e-0d50-478c-9a2b-3df9cc399bd6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.653145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233a8e-0d50-478c-9a2b-3df9cc399bd6 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.654769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 104/207] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:32.660386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.660760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.660959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.683435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:32.684553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:32.692097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 104/208] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:32.714017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233a8e-0d50-478c-9a2b-3df9cc399bd6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.726454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233a8e-0d50-478c-9a2b-3df9cc399bd6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.730171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.730880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.731164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.731440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.743018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:32.749637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:32.750753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 105/209] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:32.756152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.764408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39270bf3-3e75-4795-91f2-eafc01304dc8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.768490 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.769067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.769352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.769629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.770366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:32.770659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:32.795651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:32.804298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 105/210] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:32.809274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.819413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0982fe7-cadb-40f0-a2d2-0de46781052f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.823601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.824368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.824656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.824939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.826038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:32.851563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:32.852987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 106/211] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:32.857886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.867719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b4ac-e185-49ed-960b-6ba2a13c67a9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.871573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.872128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.872414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.872694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.880382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:32.905327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:32.914153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 106/212] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:49:32.919072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.928460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423dbbd-76f1-445a-85dd-78d86c51eafc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.932252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.932998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.933283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.933560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.934635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:32.960531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c9c24-0a5a-4ddd-bd7f-acd5b1f106f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:32.962057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 107/213] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:32.967437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:32.976883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88751633-6b7d-4617-9760-0d7c1041d757 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:32.980767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:32.981328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:32.981613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:32.981897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:32.982695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=50654ae35136436d96531de099d2b865) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:32.982996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:33.009324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525233-49ed-44cf-aa0b-29cc585db820 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:33.014588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 107/214] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:32 2022] GET /identity/v3/role_assignments?user.id=50654ae35136436d96531de099d2b865&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:34.977818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63654-3b8c-400d-a290-8bb3110bdc76 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:34.978364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63654-3b8c-400d-a290-8bb3110bdc76 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:34.978446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63654-3b8c-400d-a290-8bb3110bdc76 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:34.987855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 108/215] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:34.988421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:34.988421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:34.988421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.008700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:35.009816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:35.016542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 108/216] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:35.038635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd63654-3b8c-400d-a290-8bb3110bdc76 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:35.051010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd63654-3b8c-400d-a290-8bb3110bdc76 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:35.054782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:35.055513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:35.055795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:35.056071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.067277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:35.074280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:35.075327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 109/217] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:35.080731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:35.089007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7f3e-df2e-4a85-8a5f-8d8af230b6c2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:35.092871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:35.093449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:35.093740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:35.094644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.095353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:35.095654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:35.120939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:35.129139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 109/218] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:35.134282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:35.144287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd844c-fc91-4645-bfc5-64ea331624e2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:35.148175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:35.148939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:35.149225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:35.149500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.150569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:35.176707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:35.178161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 110/219] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:35 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:35.183016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:35.191895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09058cc3-12d2-4d3c-b8c9-33bd5caca143 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:35.195738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:35.196500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:35.196786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:35.197066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.198401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:35.224170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eba1cd-f13b-4602-b8ed-d75407b90f71 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:35.225641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 110/220] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:35 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:35.230659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:35.240038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653c10-a1dd-465f-bbf9-441eaa699c6d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:35.243906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:35.244688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:35.244975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:35.245255 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/50654ae35136436d96531de099d2b865/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:35.247191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c06c5abccc4ef5a867d99a20b4dd18, user_id=50654ae35136436d96531de099d2b865, role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:35.273002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42915bbe-cbe7-4701-8150-c6356cdd343f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:35.371878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 111/221] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:49:35 2022] PUT /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/users/50654ae35136436d96531de099d2b865/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:49:37.339563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3160a-1646-455d-9933-8cd49c045374 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.340063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3160a-1646-455d-9933-8cd49c045374 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.340145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3160a-1646-455d-9933-8cd49c045374 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.341799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 111/222] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:37.347572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.347949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.348145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.370672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:37.371792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:37.433540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 112/223] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:37.456843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3160a-1646-455d-9933-8cd49c045374 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.468039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3160a-1646-455d-9933-8cd49c045374 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.472815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.473533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.473818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.474157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.486195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:37.492837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:37.493900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 112/224] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:37.499317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.507722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18280c-230e-4f77-8ca2-5f367ab0670e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.511609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.512190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.512478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.512756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.513457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:37.513755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:37.539635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:37.547999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 113/225] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:37.553268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.562234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eda5e0-bded-4966-913f-06a7fd9f5aa3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.566430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.567199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.567484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.567762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.568826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:37.595542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:37.596900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 113/226] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:37.601906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.611846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd659-3936-4fc1-8b95-3ca8879e59da admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.615682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.616236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.616521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.616798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.624149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:37.649923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:37.658525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 114/227] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:37.663804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.673145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e741a-c1cc-4ebd-a06d-da6c5de272ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.676941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.677691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.678006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.678284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.679332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:37.705476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320a61d-c284-4dc1-8932-8ca1a756e18d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:37.706978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 114/228] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:37.712351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:37.720987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfcb4-04b8-4b30-98f5-2dbb0afaea69 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:37.724838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:37.725395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:37.725679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:37.725980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:37.726742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18, user.id=50654ae35136436d96531de099d2b865) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:37.727041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:37.753084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468f515-3120-48fd-9384-1f4f82e2b09b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:37.758628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 115/229] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:49:37 2022] GET /identity/v3/role_assignments?user.id=50654ae35136436d96531de099d2b865&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:39.757123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6628c6-a364-4ea2-a223-a397cb50d152 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:39.757638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6628c6-a364-4ea2-a223-a397cb50d152 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:39.757722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6628c6-a364-4ea2-a223-a397cb50d152 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:39.759383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 115/230] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:39.764316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:39.764737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:39.764884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:39.788475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:39.789576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:39.796083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 116/231] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:39.817412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6628c6-a364-4ea2-a223-a397cb50d152 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:39.829788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6628c6-a364-4ea2-a223-a397cb50d152 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:39.833599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:39.834327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:39.834610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:39.834885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:39.835908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:39.862080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95e04-6fd4-49e0-b838-32b48cd5bf4f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:39.863495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 116/232] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:39.868581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:39.877322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1d674-5781-42f9-b014-8bcb02fed452 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:39.881563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:39.882190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:39.882480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:39.882764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] PATH_INFO: `/v3/groups` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:39.883399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:39.908341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:49:39.908341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:49:39.908341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:49:39.909504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc899a7-2ef9-4281-930e-7c3354a00fa6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:39.985076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 117/233] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Apr 6 09:49:39 2022] POST /identity/v3/groups => generated 229 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:49:41.990880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe358c-39d3-45d9-8312-f0d17967ff27 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:41.991350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe358c-39d3-45d9-8312-f0d17967ff27 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:41.991439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe358c-39d3-45d9-8312-f0d17967ff27 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:41.993097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 117/234] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:41.998401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:41.998774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:41.998968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:42.021354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:42.022489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:42.028986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 118/235] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:42.051188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe358c-39d3-45d9-8312-f0d17967ff27 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:42.063093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe358c-39d3-45d9-8312-f0d17967ff27 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:42.066892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:42.067591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:42.067876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:42.068153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:42.069189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:42.094779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694842bf-e011-4811-b5e6-8b65c5287a29 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:42.096200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 118/236] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:42.101365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:42.110369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763d4cf-5c8c-4bb6-b429-0284adeb9662 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:42.114254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:42.114836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:42.115124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:42.115405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] PATH_INFO: `/v3/groups` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:42.116031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:42.141481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582d64f-98a9-4265-b60b-406a76d404b0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:42.229126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 119/237] 10.222.0.11 () {60 vars in 1155 bytes} [Wed Apr 6 09:49:42 2022] POST /identity/v3/groups => generated 226 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:49:44.198897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d487d-221c-4ed6-96a6-233604208efe None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.199406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d487d-221c-4ed6-96a6-233604208efe None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.199492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d487d-221c-4ed6-96a6-233604208efe None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.201104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 119/238] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:44.207074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.207482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.207653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.230130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:44.231196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:44.238094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 120/239] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:44.263883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d487d-221c-4ed6-96a6-233604208efe None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.278787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d487d-221c-4ed6-96a6-233604208efe None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.283441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.284141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.284426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.284703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.296571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:44.303207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:44.304275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 120/240] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:44.309860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.318379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0911-4d94-4503-b1fc-a2e5c824253e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.322294 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.323141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.323427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.323704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.324413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:44.324711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:44.350646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:44.359418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 121/241] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:44.365002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.374195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599385b-e139-4696-8823-a0cc964eb29f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.382467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.383051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.383348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.383639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.392237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:44.418452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:44.426884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 121/242] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:44.432597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.441999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04c32-faff-433c-9b10-d48d53b87158 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.445828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.446633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.446923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.447203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.448526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:44.474888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:44.476385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 122/243] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:44.481423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.489712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac3c4f-900d-4c1e-ab76-e0e760a69a85 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.493601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.494405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.494697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.494981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.499831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:44.524641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:49:44.524641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:49:44.524641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:49:44.525815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7af8-a809-4e88-9b56-5a41d5f4deb6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:44.527273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 122/244] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:44.532844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:44.541809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf787da-79a8-42a0-9c85-2c2d51911214 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:44.545575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:44.546157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:44.546444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:44.547319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:44.548080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=c8792ac1fff2499693ec24addb914ca7) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:44.548380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:44.574247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae850e-df5c-465d-98d9-8a115e3344ee admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:44.579401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 123/245] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:49:44 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:46.514819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8530-05c4-4481-9919-7a31cc1e32a7 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.515885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8530-05c4-4481-9919-7a31cc1e32a7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.515988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8530-05c4-4481-9919-7a31cc1e32a7 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.517623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 123/246] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:46.522586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.522970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.523155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.544995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:46.546142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:46.553341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 124/247] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:46.575185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8530-05c4-4481-9919-7a31cc1e32a7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:46.586757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8530-05c4-4481-9919-7a31cc1e32a7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:46.590644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:46.591346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.591636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.591919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.602793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:46.609687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:46.610758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 124/248] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:49:46.615915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:46.624268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16939-f00a-43ed-a256-dd24d8ea4f32 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:46.628747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:46.629327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.629613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.629892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.630629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:46.630926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:46.655488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:46.663912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 125/249] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:46.669051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:46.679646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff7033-d6bb-4001-a801-f489e10058b3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:46.683534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:46.684291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.684581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.684864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.685911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:46.712727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:46.714192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 125/250] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:46 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:46.719670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:46.728802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa54ce-2baa-465f-90d3-4a9c1489cd5e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:46.732639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:46.733414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.733707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.734150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.735324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:46.760386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3432-c570-465d-88cb-ad3dcba2c470 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:46.761912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 126/251] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:46 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:46.768242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:46.777433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400238-d3d1-45a3-ad45-dad67fc335ef admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:46.782059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:46.782861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:46.783152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:46.783442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7/groups/062dd0a430214619868da5b1e560de90/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:46.785193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8792ac1fff2499693ec24addb914ca7, group_id=062dd0a430214619868da5b1e560de90, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:46.811021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a88dd2-9302-45c9-b3bd-a3505f6c2d08 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:46.891527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 126/252] 10.222.0.11 () {58 vars in 1463 bytes} [Wed Apr 6 09:49:46 2022] PUT /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7/groups/062dd0a430214619868da5b1e560de90/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:49:48.824810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e3f8-343b-4724-8bc9-e2a977a86cd7 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:48.825364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e3f8-343b-4724-8bc9-e2a977a86cd7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:48.825364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e3f8-343b-4724-8bc9-e2a977a86cd7 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:48.827081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 127/253] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:48.832008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:48.832376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:48.832571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:48.854211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:48.855334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:48.916777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 127/254] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:48.939466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e3f8-343b-4724-8bc9-e2a977a86cd7 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:48.951214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e3f8-343b-4724-8bc9-e2a977a86cd7 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:48.955164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:48.955930 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:48.956221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:48.956506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:48.969501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:48.975922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:48.977007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 128/255] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:48.982593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:48.991919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e7841-8cca-48ec-a21a-b74c65ef49c9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:48.995840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:48.996423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:48.996707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:48.996984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:48.997688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:48.998016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:49.023781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:49.032281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 128/256] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:49.037443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:49.047248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fba5f8-d615-4597-b8e8-c0d9747ee6e4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:49.051172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:49.051744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:49.052032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:49.052310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:49.063288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:49.088598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:49.098014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 129/257] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:49.103644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:49.113377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a394-af69-47df-8b22-f1ef9452ad84 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:49.117202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:49.118007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:49.118294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:49.118572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:49.119630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:49.144721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:49.146233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 129/258] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:49 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:49.151188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:49.160118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced90a84-95ae-4c8c-9401-2953a8c5ebf2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:49.164040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:49.164803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:49.165089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:49.165368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:49.166440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:49.191243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:49:49.191243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:49:49.191243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:49:49.192391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fa23d-025e-49c1-9e93-42f9e58b78ac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:49.193826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 130/259] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:49 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:49.199558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:49.209890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf1eb-126d-40f9-979d-daabfc18e232 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:49.213673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:49.214262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:49.214551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:49.214831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:49.215592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=c8792ac1fff2499693ec24addb914ca7) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:49.215892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:49.242964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b729-de8c-4766-9ede-544d71c1b589 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:49.248523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 130/260] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:49:49 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:51.215824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a87c2-7aee-4c09-add2-608d7239e94c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.216383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a87c2-7aee-4c09-add2-608d7239e94c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.216383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a87c2-7aee-4c09-add2-608d7239e94c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.218663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 131/261] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:51.223552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.223991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.224122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.246076 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:51.247130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:51.253972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 131/262] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:51.276373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a87c2-7aee-4c09-add2-608d7239e94c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.288475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a87c2-7aee-4c09-add2-608d7239e94c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.292251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.292959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.293246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.293524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.304582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:51.311346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:51.312942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 132/263] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:51.318359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.326980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f39d7a-a7de-4dd4-ba52-23ed74af315f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.331566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.332144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.332433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.332715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.333419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:51.333720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:51.358569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:51.366795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 132/264] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:51.371802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.382258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6fe4-2588-4ec5-8d62-a883285d6987 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.386127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.386681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.386967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.387246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.395394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:51.419859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:51.428173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 133/265] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:51.433251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.442649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48444e3-90eb-4364-b855-bb7f3047737f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.446509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.447273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.447818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.448100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.449164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:51.475049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:51.476528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 133/266] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:51.481475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.490204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fb349-dc9f-450d-b353-e461ad00487b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.494005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.494760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.495061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.495335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.496400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:51.523079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ce5e-3e84-470e-9143-3dfbc959a318 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:51.524493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 134/267] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:51.529696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:51.538651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7946a-7fac-4991-91a4-00cd0e9b9123 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:51.542460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:51.543022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:51.543307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:51.543585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:51.544345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=c8792ac1fff2499693ec24addb914ca7) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:51.544644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:51.571204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10746-ff71-4f8b-9873-129f63008762 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:51.576558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 134/268] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:49:51 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:49:53.523747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f125b81-45ae-43fc-8514-97e76e4b550c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.524287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f125b81-45ae-43fc-8514-97e76e4b550c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.524287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f125b81-45ae-43fc-8514-97e76e4b550c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.525995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 135/269] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:53.531854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.532272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.532429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.556333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:53.557454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:53.564974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 135/270] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:53.586166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f125b81-45ae-43fc-8514-97e76e4b550c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:53.598263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f125b81-45ae-43fc-8514-97e76e4b550c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:53.601989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:53.602698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.602984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.603257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.614652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:53.621427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:53.622499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 136/271] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:53.628168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:53.636548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1de3b9-c0e6-45d6-9325-cde56f3aaebb None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:53.640785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:53.641372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.641658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.641953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.642673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:53.642969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:53.668525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:53.677261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 136/272] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:53.682384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:53.692381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2d871-7102-4a10-8293-aa8cac629a35 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:53.696256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:53.697011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.697559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.697833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.698916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:53.725169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:53.726697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 137/273] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:53 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:53.731598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:53.741170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e4ffb-1a57-4207-80f0-2893a8b8f795 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:53.745044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:53.745813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.746136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.746417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.747480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:53.772688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c7c14-a77b-4021-9d00-e364e76979a4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:53.774260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 137/274] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:53 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:53.779143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:53.788878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a946b3-3cb5-45f4-86da-89e8d802655e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:53.793682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:53.794499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:53.794790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:53.795066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7/groups/062dd0a430214619868da5b1e560de90/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:53.798084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8792ac1fff2499693ec24addb914ca7, group_id=062dd0a430214619868da5b1e560de90, role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:53.824013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f54d7-aa3c-4be9-af7c-ad2ae3b1767e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:53.904274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 138/275] 10.222.0.11 () {58 vars in 1463 bytes} [Wed Apr 6 09:49:53 2022] PUT /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7/groups/062dd0a430214619868da5b1e560de90/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:49:55.873763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2009-7c98-43e2-af21-f67a83446608 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:55.874372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2009-7c98-43e2-af21-f67a83446608 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:55.874372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2009-7c98-43e2-af21-f67a83446608 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:55.876022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 138/276] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:55.881919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:55.882376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:55.882503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:55.904481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:55.906239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:55.969118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 139/277] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:49:55.991743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a2009-7c98-43e2-af21-f67a83446608 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.004661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a2009-7c98-43e2-af21-f67a83446608 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.009462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.010744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.011269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.011561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.024122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:56.030964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:49:56.032062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 139/278] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:49:56.037862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.046510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eab59-626b-4f8c-bf09-bf6fc05ac7bf None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.050391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.050977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.051260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.051538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.052241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:56.052535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:56.079263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:56.087369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 140/279] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:56.092486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.101879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608fcdd-107f-4743-84b8-a3dd138d36fc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.105636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.106229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.106515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.106788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.114645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:56.141774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:56.149855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 140/280] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:56.155015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.164140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272171cd-3404-4d70-9941-84fa9f3371e1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.167971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.168733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.169018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.169295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.170374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:56.196934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:56.198699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 141/281] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:56 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:56.204058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.212204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322894c-3f8d-4fb1-affb-4a773fdac7fb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.216022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.216783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.217066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.217345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.218835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:56.244916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dca41c-6580-4865-ae7a-1bbde024d647 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:56.246380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 141/282] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:56 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:56.251618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:56.260534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50edd-306d-4688-8638-75b1ff8cf47d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:56.264269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:56.265359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:56.265643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:56.265922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:56.266710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=c8792ac1fff2499693ec24addb914ca7) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:56.267010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:56.294202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022bca-815b-4096-ae03-d974e0cace9b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:56.301014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 142/283] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:49:56 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=c8792ac1fff2499693ec24addb914ca7&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:58.271039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45171-82cd-4c14-9b7f-26a292741fa2 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.271529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45171-82cd-4c14-9b7f-26a292741fa2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.271529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45171-82cd-4c14-9b7f-26a292741fa2 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.273167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 142/284] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:49:58.278221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.278604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.278815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.301819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:49:58.302986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:49:58.309428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 143/285] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:49:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:49:58.331523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45171-82cd-4c14-9b7f-26a292741fa2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.343254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45171-82cd-4c14-9b7f-26a292741fa2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.347512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.348222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.348509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.348787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.360717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:49:58.367231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:49:58.368309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 143/286] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:49:58.373520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.382016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309d8f4-13f1-4235-ad2b-d62b7d6b6cb9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.385875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.386495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.386783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.387063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.387772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:58.388072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:58.413592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:58.422680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 144/287] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:58.428358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.438822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ad72f-c691-4b5b-bc72-d41eed530dfe admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.442699 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.443266 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.443552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.443833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.451569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:58.477820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:58.486198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 144/288] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:49:58.491689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.501142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bc780-732c-4f7e-a54a-82c754222111 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.504946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.505711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.506024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.506304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.507349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:58.533390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:58.534895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 145/289] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:58.539827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.548258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493aaa-e2e4-4dce-a2b6-8dd934cf3e7e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.552161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.552920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.553206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.553486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.554557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:58.580609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497c08d-0652-4ad5-ad2e-614d50d1dfa5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:58.582040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 145/290] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:49:58.587301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:49:58.596971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97938-c078-4044-bc4a-f4abe0976e9c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:49:58.600808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:49:58.601369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:49:58.601658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:49:58.601958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:49:58.602749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:49:58.603056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:49:58.628987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7bf77-a746-4953-b93d-9d2b715fe61e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:49:58.634429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 146/291] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:49:58 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:00.586832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84167c4-028d-4104-948a-b1edd8d6ff4b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.587348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84167c4-028d-4104-948a-b1edd8d6ff4b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.587468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84167c4-028d-4104-948a-b1edd8d6ff4b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.589044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 146/292] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:00.594696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.595097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.595262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.617795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:00.618928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:00.625397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 147/293] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:00.647056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84167c4-028d-4104-948a-b1edd8d6ff4b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:00.659202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84167c4-028d-4104-948a-b1edd8d6ff4b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:00.663035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:00.663739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.664029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.664313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.675848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:00.682191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:50:00.683380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 147/294] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:00.688919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:00.697480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a344df-f295-4f13-9b81-ade5153b91c7 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:00.701306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:00.702388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.702711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.702959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.703651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:00.703943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:00.729546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:00.738364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 148/295] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:00.743463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:00.753320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13c4e5-a6eb-4640-a49c-7a570559423d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:00.757354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:00.758156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.758444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.758725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.759772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:00.785835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:00.787302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 148/296] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:00 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:00.792191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:00.800984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae23ebc-7651-46e3-8ba2-54dd7c12b273 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:00.804790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:00.805546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.805829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.806138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.807185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:00.832831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7678-6bf4-4c68-bcc9-fcf0b94f4c21 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:00.834359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 149/297] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:00 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:00.839352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:00.848881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8894b-26ef-4b67-83e1-0fd2b3a33a64 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:00.852749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:00.853525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:00.853811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:00.854126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/groups/062dd0a430214619868da5b1e560de90/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:00.855811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c06c5abccc4ef5a867d99a20b4dd18, group_id=062dd0a430214619868da5b1e560de90, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:00.881717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df7cbc-e668-4436-9bd8-901e107ed89f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:00.954288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 149/298] 10.222.0.11 () {58 vars in 1463 bytes} [Wed Apr 6 09:50:00 2022] PUT /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/groups/062dd0a430214619868da5b1e560de90/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:50:02.898565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609ada-137e-4934-b551-7c22ed227b98 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:02.899084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609ada-137e-4934-b551-7c22ed227b98 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:02.899168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609ada-137e-4934-b551-7c22ed227b98 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:02.900815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 150/299] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:02.906632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:02.907047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:02.907197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:02.929761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:02.930916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:02.993696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 150/300] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:03.016139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609ada-137e-4934-b551-7c22ed227b98 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.027445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609ada-137e-4934-b551-7c22ed227b98 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.032004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.032703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.032989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.033267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.044894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:03.051243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 09:50:03.052309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 151/301] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:03.057616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.066025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af90ac-a0c4-4efa-9b7c-ab3e8f302ae4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.070046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.070641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.070927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.071205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.072175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:03.072470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:03.098922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:03.116996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 151/302] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:03.122729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.132126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f47c4-43bf-4707-9633-53a54d3670f6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.135974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.136541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.136825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.137099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.145024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:03.170304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:03.178613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 152/303] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:03.184008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.193185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f6bb-8aaa-492c-8d70-e9a81c238e88 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.197309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.198121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.198409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.198690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.199766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:03.226390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:03.227898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 152/304] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:03.232879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.241191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bafae-1c3d-43b5-b472-b9110dde7990 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.245083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.245837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.246149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.246473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.247502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:03.272796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbaa3c-6282-475d-b328-f77259197fd7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:03.274244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 153/305] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:03.279526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:03.288765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb999e-b4d6-4f9a-8867-1cb042c24e96 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:03.292629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:03.293186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:03.293479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:03.293763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:03.294581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=7a8ad31f1583471d86055e9e6f0ac142, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:03.294889 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:03.321237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e578dc-8c35-4a6c-9c34-ecf7840170bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:03.327189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 153/306] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:50:03 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=7a8ad31f1583471d86055e9e6f0ac142 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:05.311067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84961b2-b1b0-4d83-8a6d-e5b8347ff143 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.311585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84961b2-b1b0-4d83-8a6d-e5b8347ff143 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.311668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84961b2-b1b0-4d83-8a6d-e5b8347ff143 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.313341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 154/307] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:05.318485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.318891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.319055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.341802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:05.343983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:05.350478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 154/308] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:05.372709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84961b2-b1b0-4d83-8a6d-e5b8347ff143 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.384080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84961b2-b1b0-4d83-8a6d-e5b8347ff143 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.387890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.388600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.388889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.389679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.400633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:05.408074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:50:05.409140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 155/309] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:05.414427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.422895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f36e33-5f20-4923-b511-a1bbc6233b3b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.426791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.427372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.427661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.427942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.428648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:05.428947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:05.454925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:05.463076 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 155/310] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:05.468771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.478828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6c18-de64-4736-9817-b678761f4384 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.482702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.483454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.483578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.483861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.491352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:05.516703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:05.524967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 156/311] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 09:50:05.530855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.539921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866b4f-bdb6-4227-9dc9-d7c2587dabb0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.543783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.544553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.544840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.545127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.547018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:05.573080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:05.574537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 156/312] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:05.579511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.587753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb8af-cff0-4036-a66d-8f4d3fcb197b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.591683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.593062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.593350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.593633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.594718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:05.620154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86069d16-b0ec-4b9b-bccc-c406263bf90c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:05.621577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 157/313] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:05.626871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:05.635702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388d512-efe2-42d1-bf12-959d2a826b72 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:05.639521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:05.640074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:05.640364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:05.640649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:05.641412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:05.641715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:05.667333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dfd19-31cd-4dc4-b6e1-2c445e49b83e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:05.672910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 157/314] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:50:05 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:07.621657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb28-1854-457c-8d90-dd3ec9b1af69 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.622208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb28-1854-457c-8d90-dd3ec9b1af69 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.622292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eb28-1854-457c-8d90-dd3ec9b1af69 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.624504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 158/315] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:07.629473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.629904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.630072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.651840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:07.652956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:07.659710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 158/316] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:07.685719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1eb28-1854-457c-8d90-dd3ec9b1af69 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:07.698443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1eb28-1854-457c-8d90-dd3ec9b1af69 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:07.702733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:07.703446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.703731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.704006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.714819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:07.726182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:50:07.727243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 159/317] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:50:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:07.733371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:07.741839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf859-81aa-4b76-bd40-02bf05cf99a5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:07.745728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:07.746344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.746631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.746910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.747671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:07.747975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:07.773529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:07.781906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 159/318] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:07.786946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:07.797335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28e866-fa6f-41dc-8fc0-03782cf4329a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:07.801172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:07.801920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.802231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.802508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.803532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:07.829074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:07.830524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 160/319] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:07 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:07.835593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:07.845173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19a94b-5826-4274-8c95-7f97093331c3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:07.849052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:07.849821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.850148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.850431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.851496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:07.877828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909754-db20-4563-8b34-bbeb337c1930 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:07.879287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 160/320] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:07 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:07.884240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:07.893477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96544a-8099-4eaa-b8c9-e7026fb44970 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:07.897296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:07.898110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:07.898399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:07.898678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/groups/062dd0a430214619868da5b1e560de90/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:07.900582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c06c5abccc4ef5a867d99a20b4dd18, group_id=062dd0a430214619868da5b1e560de90, role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:07.927602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2a47f-cb00-4ecb-a36c-2a6587093f51 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:08.001471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 161/321] 10.222.0.11 () {58 vars in 1463 bytes} [Wed Apr 6 09:50:07 2022] PUT /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18/groups/062dd0a430214619868da5b1e560de90/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:50:10.008363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876341-1a8c-4440-9c8c-f1dc081e620b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.008779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876341-1a8c-4440-9c8c-f1dc081e620b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.008935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876341-1a8c-4440-9c8c-f1dc081e620b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.010645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 161/322] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:10.016472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.016903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.017029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.038897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:10.040006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:10.110752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 162/323] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:10.133314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876341-1a8c-4440-9c8c-f1dc081e620b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.144802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876341-1a8c-4440-9c8c-f1dc081e620b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.148743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.149483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.149771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.150099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.162416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:10.169115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:50:10.170825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 162/324] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:10.176275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.184603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05ea6-976d-4e26-920d-107ce4b49ecd None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.189072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.189667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.189977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.190261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.190972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:10.191271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:10.216219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:10.224963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 163/325] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:10.230182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.239867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d111-cbe8-4698-808b-b3a82126317a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.243641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.244195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.244480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.244759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.252575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:10.277640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:10.286529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 163/326] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:10.291790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.301335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723808-bfe9-4cc5-b2d5-5bf93065f37d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.305156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.305917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.306236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.306518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.307586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:10.338174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:10.339731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 164/327] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:10.345717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.354123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd940221-dde5-44e2-b79c-9f99c8a10074 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.358669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.359427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.359711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.359986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] PATH_INFO: `/v3/groups/062dd0a430214619868da5b1e560de90` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.361036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=062dd0a430214619868da5b1e560de90)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:10.386151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a27335-acb6-4e68-a02f-0f33ac6e87c8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:10.387567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 164/328] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/groups/062dd0a430214619868da5b1e560de90 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:10.393060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:10.402210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039922f-d91f-4f3a-a22c-dec79792e8df admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:10.406749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:10.407311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:10.407600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:10.407881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:10.408644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] RBAC: Adding query filter params (group.id=062dd0a430214619868da5b1e560de90, role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:10.408948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:10.434310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1903cc-4d92-49b1-ba38-09961077e802 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:10.439909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 165/329] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:50:10 2022] GET /identity/v3/role_assignments?group.id=062dd0a430214619868da5b1e560de90&scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:12.402533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb46b4-752a-4ea9-9caa-110c2a6a692a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.403083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb46b4-752a-4ea9-9caa-110c2a6a692a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.403083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb46b4-752a-4ea9-9caa-110c2a6a692a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.405252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 165/330] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:12.410398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.410787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.410965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.433394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:12.434534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:12.441071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 166/331] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:12.462728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb46b4-752a-4ea9-9caa-110c2a6a692a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.474700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb46b4-752a-4ea9-9caa-110c2a6a692a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.478604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.479303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.479588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.479866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.490912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:12.497134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:12.498787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 166/332] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:12.504382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.512798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fb54-c41f-4eab-a608-72a580bfb4b8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.516957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.517543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.517830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.518139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.518845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:12.519144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:12.544154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:12.553195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 167/333] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:12.558249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.568229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75490-b6f1-48cd-b46d-a0367f15c8a1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.572389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.572941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.573225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.573504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.581086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:12.606314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:12.615045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 167/334] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:12.620355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.629450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64873-6409-44f7-9e79-736242e3eb89 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.633277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.634080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.634369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.634649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.635702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] RBAC: Authorizing `identity:get_project(project_id=243059ad00e449c5acfc061092a4626d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:12.660923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:12.662381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 168/335] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/projects/243059ad00e449c5acfc061092a4626d => generated 344 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:12.667281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.676469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e031-b37f-41c7-886c-2e209e3adb2f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.680413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.681171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.681459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.681738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] PATH_INFO: `/v3/groups/04377178198e4e9ca40b598b6d824358` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.686641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] RBAC: Authorizing `identity:get_group(group_id=04377178198e4e9ca40b598b6d824358)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:12.712884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091156e1-842f-45be-a9d1-012040f675b6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:12.714333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 168/336] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/groups/04377178198e4e9ca40b598b6d824358 => generated 229 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:12.720200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:12.729554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193480e-3d7e-4304-b32c-cd02c131dc41 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:12.733486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:12.734078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:12.734365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:12.734642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:12.735403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] RBAC: Adding query filter params (group.id=04377178198e4e9ca40b598b6d824358, role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=243059ad00e449c5acfc061092a4626d) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:12.735702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:12.760598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bdc2-33f7-4637-b703-6ae8c32ed02a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:12.766353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 169/337] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:50:12 2022] GET /identity/v3/role_assignments?group.id=04377178198e4e9ca40b598b6d824358&scope.project.id=243059ad00e449c5acfc061092a4626d&role.id=2d75a104a2e84475b408c49f7034503e => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:14.702157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71cce-5d65-4539-a365-503d6e0368ca None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.702677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71cce-5d65-4539-a365-503d6e0368ca None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.702791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac71cce-5d65-4539-a365-503d6e0368ca None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.704404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 169/338] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:14.709349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.709759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.709914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.733237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:14.734371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:14.740848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 170/339] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:14.762096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac71cce-5d65-4539-a365-503d6e0368ca None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:14.773458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac71cce-5d65-4539-a365-503d6e0368ca None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:14.777284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:14.778016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.778308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.778591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.790125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:14.797033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:14.798124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 170/340] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:14.803402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:14.811952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605b2f-a4e2-4380-b50f-2c353487afc9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:14.815877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:14.816463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.816754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.817038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.817744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:14.818090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:14.843508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:14.851871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 171/341] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:14.856957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:14.867443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0df1d7-dd38-41c2-9e6f-b2cde1f80bd2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:14.871329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:14.872082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.872371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.872651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] PATH_INFO: `/v3/groups/04377178198e4e9ca40b598b6d824358` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.873778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] RBAC: Authorizing `identity:get_group(group_id=04377178198e4e9ca40b598b6d824358)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:14.898865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:14.900288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 171/342] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:14 2022] GET /identity/v3/groups/04377178198e4e9ca40b598b6d824358 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:14.905716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:14.914652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ef7b-5dfd-4f83-a86d-014b72591fa2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:14.918528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:14.919288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.919577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.919865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.921492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=243059ad00e449c5acfc061092a4626d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:14.946182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffd7cd-811b-496b-9918-2f17f7f3b0c1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:14.947940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 172/343] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:14 2022] GET /identity/v3/projects/243059ad00e449c5acfc061092a4626d => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:14.953689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:14.962720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9920d27-5426-4dca-b872-143eb315869e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:14.966587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:14.968064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:14.968356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:14.968642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d/groups/04377178198e4e9ca40b598b6d824358/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:14.970401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] RBAC: Authorizing `identity:create_grant(project_id=243059ad00e449c5acfc061092a4626d, group_id=04377178198e4e9ca40b598b6d824358, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:14.996177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c18e23-78b7-457d-a35d-5e60f3e6677e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:15.104255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 172/344] 10.222.0.11 () {58 vars in 1463 bytes} [Wed Apr 6 09:50:14 2022] PUT /identity/v3/projects/243059ad00e449c5acfc061092a4626d/groups/04377178198e4e9ca40b598b6d824358/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:50:17.074061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee92d-c03c-4134-bb38-b6da63be7861 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.074544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee92d-c03c-4134-bb38-b6da63be7861 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.074628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee92d-c03c-4134-bb38-b6da63be7861 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.076349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 173/345] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:17.081343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.081718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.081914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.105567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:17.106743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:17.168809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 173/346] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:17.191090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ee92d-c03c-4134-bb38-b6da63be7861 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.203325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ee92d-c03c-4134-bb38-b6da63be7861 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.207109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.207809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.208097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.208379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.220781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:17.227119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:17.228185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 174/347] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:17.233575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.241802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a81f5c-518f-4d3e-9828-e56e8d85929f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.245642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.246256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.246542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.246819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.247525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:17.247847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:17.273112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:17.281912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 174/348] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:17.287090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.296156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4223d5-a9f7-4e27-85bd-7c9818312667 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.300027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.300587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.300877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.301158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.308618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:17.334033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:17.342883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 175/349] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:17.347935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.356874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9c4d-61e3-469e-8fb1-dc0536dafd3b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.360869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.361642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.361954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.362246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.363313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] RBAC: Authorizing `identity:get_project(project_id=243059ad00e449c5acfc061092a4626d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:17.389124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:17.390564 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 175/350] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/projects/243059ad00e449c5acfc061092a4626d => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:17.395387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.403560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe8a3-d791-4d3e-afd1-b7c790400441 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.408093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.408844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.409134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.409417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] PATH_INFO: `/v3/groups/04377178198e4e9ca40b598b6d824358` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.410479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] RBAC: Authorizing `identity:get_group(group_id=04377178198e4e9ca40b598b6d824358)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:17.435216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2ae49-767f-42f8-b127-a0fe93a50908 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:17.436660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 176/351] 10.222.0.11 () {56 vars in 1201 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/groups/04377178198e4e9ca40b598b6d824358 => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:17.441856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:17.452712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50672a4-ba92-4d2d-ae74-3df703fccf7f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:17.474517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:17.475082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:17.475365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:17.475641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:17.476410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] RBAC: Adding query filter params (group.id=04377178198e4e9ca40b598b6d824358, role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=243059ad00e449c5acfc061092a4626d) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:17.476708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:17.502097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921048-69ac-435b-bfd8-13beeddea125 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:17.507911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 176/352] 10.222.0.11 () {56 vars in 1397 bytes} [Wed Apr 6 09:50:17 2022] GET /identity/v3/role_assignments?group.id=04377178198e4e9ca40b598b6d824358&scope.project.id=243059ad00e449c5acfc061092a4626d&role.id=2d75a104a2e84475b408c49f7034503e => generated 611 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:19.549686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01193a-681e-4465-b9fb-399ae2bff973 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:19.550247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01193a-681e-4465-b9fb-399ae2bff973 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:19.550387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01193a-681e-4465-b9fb-399ae2bff973 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:19.552107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 177/353] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:19.557081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:19.557496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:19.557645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:19.580320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:19.581428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:19.587922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 177/354] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:19.611203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01193a-681e-4465-b9fb-399ae2bff973 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:19.622440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01193a-681e-4465-b9fb-399ae2bff973 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:19.626863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:19.627561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:19.627846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:19.628126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:19.640352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:19.665035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:19.682122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:19.683171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 178/355] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:19.689333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:19.698104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e2cb-9e80-49d5-bdf6-0d764faafd14 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:19.702390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:19.702974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:19.703262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:19.703541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:19.704228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:19.704531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:19.729462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba142bb-c772-48e6-8af5-317aab171b39 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:19.742923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 178/356] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:19.748833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:19.757880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318da24a-ba24-46ae-b223-9f668578bc5b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:19.761636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:19.762239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:19.762530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:19.762803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:19.763858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:19.790610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:19.790610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:19.790610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:19.791813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9e80-c531-440f-a72f-1852a7dbef74 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:19.943921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 179/357] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:50:19 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:50:21.949415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc737a3-35b5-4ed4-b8db-515009775314 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:21.950068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc737a3-35b5-4ed4-b8db-515009775314 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:21.950068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc737a3-35b5-4ed4-b8db-515009775314 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:21.952794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 179/358] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:21.957885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:21.958329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:21.958493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:21.980824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:21.982019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:21.988572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 180/359] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:22.010418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc737a3-35b5-4ed4-b8db-515009775314 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.022588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc737a3-35b5-4ed4-b8db-515009775314 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.026345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.027051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.027335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.027610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.039341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:22.046153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:50:22.047211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 180/360] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:22.052638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.061589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6351d5-91ee-45ea-a059-3262d3e1d8fa None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.065437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.066058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.066348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.066630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.067337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.067634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.093245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.101336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 181/361] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:22.106402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.116277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bf5d6-be15-43b7-97f5-f564869707e1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.120050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.120737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.121022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.121303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.133054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.162517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.180548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:22.183294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 181/362] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:22.189774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.199108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaf899-bbf0-4806-a346-541c73b113ce admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.203102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.203626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.203913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.204194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.204876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.205177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.229837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:22.229837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:22.229837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:22.230717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.243884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 182/363] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:22.249188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.258172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34d387-28fa-49e4-b595-09fe4a4f1559 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.262006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.262700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.262983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.265062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.277548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.303867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.325770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:22.327009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 182/364] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:22.332632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.342877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384604-6cf4-49fe-99ad-acbd35bab8df admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.346718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.347302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.347590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.347868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.348648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.348947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.378454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:22.378454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:22.378454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:22.379586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.409136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 183/365] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:22.415791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.427770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb00d95-7d54-4939-8cc8-8c642ed69c58 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.431993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.432811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.433106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.433587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.443313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.475360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.486327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 183/366] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:22.491886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.503613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a67d5-751a-4ee2-8146-e5bd9993812b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.508158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.508934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.509332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.509709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.528887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.557840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.581808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:22.583670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 184/367] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:22.589295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.599400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e4a71-fca0-439e-92c8-526ce9c6d0fa admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.606760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.607689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.608155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.608618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.609784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.610310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.642996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.661944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 184/368] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:22.668098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.678123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c9a4-ee2f-4a3c-966e-aa32289a96bd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.682056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.682770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.683054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.683328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.697453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.727315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.744202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:22.745329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 185/369] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:22.751495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.761876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa981d1-f9a6-4d89-b759-d974b1c0e455 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.766764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.767354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.767647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.767932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.768683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.768984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.795276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:22.795276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:22.795276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:22.797028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335f6d-3614-4dfe-9a37-01a1031900d5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.811655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 185/370] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:22.819810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:22.832101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0233c-75fc-48e5-849e-d6a10c372cec admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:22.837868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:22.838481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:22.838764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:22.839040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:22.839831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:22.840134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:22.869461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c07de1-20fe-4ea6-9376-a71f528b92c4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:22.877728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 186/371] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:50:22 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:24.857218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd455e-3cae-40d2-a77d-139c30a4e64f None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:24.857765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd455e-3cae-40d2-a77d-139c30a4e64f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:24.857765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd455e-3cae-40d2-a77d-139c30a4e64f None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:24.859466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 186/372] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:24.864494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:24.864887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:24.865057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:24.963370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:24.964537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:24.971858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 187/373] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:24.992883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd455e-3cae-40d2-a77d-139c30a4e64f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.004516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd455e-3cae-40d2-a77d-139c30a4e64f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.008304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.009014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.009304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.009585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.021134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:25.027559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:50:25.028630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 187/374] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:25.034002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.042357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd34bd0-9d44-41e8-a023-aa64c3f3659d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.046794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.047373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.047661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.047938 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.048642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:25.048936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.077303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.086085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 188/375] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:25.092105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.101718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371d38-7445-41c4-9252-1a0e59e2e4fb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.105605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.106350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.106640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.107563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.118628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.144046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.161881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:25.162953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 188/376] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:25.168349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.178216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8ca5-0099-48c4-a4c0-d87759e6100a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.182101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.182681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.182972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.183268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.183937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:25.184237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.209009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.221878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 189/377] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:25.226925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.236468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8d29a-3dd0-4988-a9f5-ef1969256713 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.240327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.241020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.241311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.241620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.255605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.281442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.299682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:25.300725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 189/378] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:25.306007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.315235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f32fa-408a-4256-a77d-5a72ebd82b20 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.319213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.319793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.320076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.320352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.321390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:25.321684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.347350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.377276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 190/379] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:25.382533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.391764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990ed0f-9c53-4750-97ce-aa2a18de3335 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.395603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.396311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.396597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.396874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.484671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.509405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.527142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:25.528246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 190/380] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:25.534538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.543590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804499e-0a5d-4999-9fd0-5551e4bf218e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.547968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.548545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.548827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.549102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.549775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:25.550110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.575454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.587130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 191/381] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:25.592574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.601587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95a1ef-c758-49db-809a-4c4f4d1a84d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.605402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.606130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.606415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.606693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.615859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.642427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.655969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:25.657000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 191/382] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:25.662178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.671677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8865c-ef14-41ef-bdcc-d2ce96c67f8c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.675490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.676056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.676341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.676618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.677348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:25.677646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.702954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:25.702954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:25.702954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:25.704055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc8427-6b7e-4511-bbd0-a7dd25c38859 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.717229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 192/383] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:25.722613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:25.731551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae20a44-0204-4860-b794-ce48807347a3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:25.735672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:25.736470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:25.736759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:25.737044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:25.756973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=7be23285393b46bfb3a98e839c603cb6, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:25.784024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764c7f-0016-4953-b709-f73aa068e2ca admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:25.875488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 192/384] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:50:25 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:50:27.852223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a001304-5772-46c9-9bdb-fd8b67c1a486 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:27.852742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a001304-5772-46c9-9bdb-fd8b67c1a486 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:27.852884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a001304-5772-46c9-9bdb-fd8b67c1a486 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:27.854540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 193/385] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:27.860248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:27.860753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:27.860843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:27.882940 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:27.884051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:27.945077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 193/386] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:50:27.967141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a001304-5772-46c9-9bdb-fd8b67c1a486 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:27.978397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a001304-5772-46c9-9bdb-fd8b67c1a486 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:27.982707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:27.983408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:27.983691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:27.983972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:27.994873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:28.001998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:50:28.003067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 194/387] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:28.008521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.017173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d4cd9-2906-4569-a894-e3a0b7d41d00 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.021133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.021718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.022044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.022329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.023037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.023337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.048719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.056855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 194/388] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:28.064431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.074286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee812-e352-4944-8d98-f932f315ac8d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.078311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.079014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.079307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.079591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.090600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.116620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.133672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:28.134748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 195/389] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:28.139908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.148991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ad72-fc81-47b2-a63d-608dc11c9e11 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.152873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.153448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.154286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.154597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.155289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.155586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.180962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.193708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 195/390] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:28.198892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.207920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3637bd-9a34-44ec-bbe9-968218e2d17e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.211830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.212519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.212807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.213088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.225879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.251817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.268908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:28.269970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 196/391] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:28.275165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.284713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903b017-bb97-43f1-856d-9b0c05a20498 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.288629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.289207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.289495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.289775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.290597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.290898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.316325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:28.316325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:28.316325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:28.317451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.347119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 196/392] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:28.352654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.362356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9704-524e-4fcc-8cee-0c06933be4d5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.366213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.366824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.367065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.367343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.374766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.403110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.412215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 197/393] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:28.417776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.427937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada64e8-f73f-402f-962e-fe6bf87a066f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.431985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.432691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.432974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.433253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.445035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.472061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.488585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:28.489689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 197/394] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:28.494953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.503275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f24b4-51e6-4cfc-8a0e-94a48ce588cf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.507157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.507728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.508012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.508290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.508961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.509259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.535437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.548366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 198/395] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:28.553671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.563085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e43dc-30f8-4dc3-87da-fb0e937e7785 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.566923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.567624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.567908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.568185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.579533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.605462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.619190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:28.620164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 198/396] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:28.625486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.634432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc74057-4395-4215-91a8-e80f0edc8efb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.639085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.639651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.639937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.640215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.640948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.641248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.666698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf54e2-8425-4beb-b1a4-c69f350aaba5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.679707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 199/397] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:28.685164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:28.694176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1e5a6-41f8-48ff-b10a-d83ac3c46109 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:28.698356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:28.698927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:28.699223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:28.699507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:28.700278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:28.701257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:28.727324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456226-5606-44b8-b2a7-93497665785a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:28.732887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 199/398] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:50:28 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:30.739524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e848a9-1866-43f7-af2c-9ac54cd044ce None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.740049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e848a9-1866-43f7-af2c-9ac54cd044ce None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.740140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e848a9-1866-43f7-af2c-9ac54cd044ce None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.741749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 200/399] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:30.746704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.747087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.747272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.770099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:30.771217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:30.777735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 200/400] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:30.799614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e848a9-1866-43f7-af2c-9ac54cd044ce None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:30.811335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e848a9-1866-43f7-af2c-9ac54cd044ce None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:30.815556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:30.816259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.816544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.816821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.828207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:30.834415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:30.835489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 201/401] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:30.840739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:30.849108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80a19-4bd3-4838-8e13-e35bc1280616 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:30.853037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:30.853615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.853902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.854213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.854921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:30.855221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:30.881028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:30.889344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 201/402] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:30.894368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:30.903677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f387e7-6575-4dab-8bd6-b45f7e63a6ef admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:30.907768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:30.908454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.908738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.909016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.919776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:30.946279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:30.964522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:30.965584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 202/403] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:30.971431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:30.980553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d205-a203-4726-ac99-ace9004876e8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:30.985324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:30.985905 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:30.986226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:30.986510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:30.987196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:30.987495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.012413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.025700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 202/404] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:31.031580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.040816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ee16-7941-453d-a686-fefda3861d49 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.044843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.045582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.045865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.046180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.058565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.084989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.102041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:31.103083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 203/405] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:31.108846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.117827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e48d6-2ea8-4a97-aa10-16c440c47426 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.121762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.122376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.122662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.122942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.124420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:31.124720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.150132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.178250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 203/406] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:31.183423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.193072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba06fad-af66-4500-b587-71f40549ef16 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.197179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.197740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.198065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.198343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.206523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.231173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.239348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 204/407] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:31.244633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.254352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d5c5-b34a-4fe6-b408-a2d229fb6b60 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.258460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.259177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.259467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.259750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.271974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.298114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.315123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:31.316230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 204/408] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:31.321729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.330687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb612f6-73eb-4609-9c19-14e60398729d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.334668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.335240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.335526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.335805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.336482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:31.336781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.361286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.374434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 205/409] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:31.379410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.388287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64bd65-8776-4976-bec5-c545ad51612e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.393110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.393803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.394111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.394388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.402941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.428472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.442285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:31.443350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 205/410] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:31.448721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.457809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca72c-abc4-4f89-bcba-e8547b0c759f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.461658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.462262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.462549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.462826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.463560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:31.463855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.489398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a44e21-5d86-4a88-b8e9-2f736876d86d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.502674 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 206/411] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:31.507948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:31.517254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546995af-052e-4d02-8b0e-2da4d7dd940d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:31.521054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:31.521613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:31.521897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:31.522261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:31.523064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:31.523364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:31.549820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0d2b-eb63-47f5-b405-f76a693b5076 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:31.554989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 206/412] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:50:31 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:33.521235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891dc0-c9f4-4a6e-94f3-a9a94c79d03c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.521753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891dc0-c9f4-4a6e-94f3-a9a94c79d03c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.521843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e891dc0-c9f4-4a6e-94f3-a9a94c79d03c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.523478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 207/413] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:33.528552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.528941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.529125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.551220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:33.552341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:33.558960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 207/414] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:33.581472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e891dc0-c9f4-4a6e-94f3-a9a94c79d03c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.593038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e891dc0-c9f4-4a6e-94f3-a9a94c79d03c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.596804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.597494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.597777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.598081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.609363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:33.615665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:33.616705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 208/415] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:33.621878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.630705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc46f-8eac-4129-ba57-4570c10bf03f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.634636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.635211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.635498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.635779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.636482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:33.636780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:33.662601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:33.671524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 208/416] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:33.676500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.686889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405027c7-a127-4755-a0f0-5be7ba9aed44 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.690826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.691508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.691790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.692066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.703717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:33.739175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:33.762617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:33.763754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 209/417] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:33.769276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.778448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69800-5db5-4a51-aa7e-dfcb45da7255 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.782336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.782911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.783196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.783473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.784151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:33.784447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:33.810133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:33.823368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 209/418] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:33.828357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.837395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42845b4e-090b-4f78-ae7a-79d9952c3ec0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.841240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.841924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.842227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.842505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.854612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:33.880037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:33.897731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:33.898793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 210/419] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:33.903986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.913550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22da5-6596-4da6-81d1-5a35ad5d61ac admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.917507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.918119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.918411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.918695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:33.919478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:33.919782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:33.945144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:33.974572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 210/420] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:33.979877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:33.989019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48509e-4121-4865-a71b-606ac3a27337 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:33.992890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:33.993592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:33.993879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:33.994197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:34.006121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:34.032089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:34.048754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:34.049796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 211/421] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:34.054941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:34.064781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9f66-8c71-4e7b-ae54-cd5f44a8cdc8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:34.068664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:34.069252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:34.069545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:34.069832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:34.070812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:34.071113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:34.096867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:34.108675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 211/422] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:34.113775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:34.122870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b91a-7b4d-4f43-8249-3af18bd16c2b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:34.127293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:34.127987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:34.128272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:34.128551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:34.137278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:34.162772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:34.176254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:34.177313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 212/423] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:34.182623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:34.192356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a680cd-8355-49ed-8487-87adcdcc4fea admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:34.196553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:34.197129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:34.197420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:34.197704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:34.198476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:34.198780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:34.224481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bcee-2264-4747-ac68-430f4af1e9f5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:34.237118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 212/424] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:34.242369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:34.251815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6702-7300-404b-a356-ef4362dffdd7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:34.255664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:34.256447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:34.256731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:34.257006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:34.258759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=7be23285393b46bfb3a98e839c603cb6, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:34.285203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259d290-6a07-4ebf-80a6-5fe04dc053b2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:34.365569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 213/425] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:50:34 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:50:36.334975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b54af-8f40-48eb-865b-7c040380c07d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.335486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b54af-8f40-48eb-865b-7c040380c07d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.335595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b54af-8f40-48eb-865b-7c040380c07d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.337184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 213/426] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:36.342821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.343233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.343387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.365967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:36.367079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:36.428184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 214/427] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:36.450922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b54af-8f40-48eb-865b-7c040380c07d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.462572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b54af-8f40-48eb-865b-7c040380c07d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.466309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.468033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.468322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.468604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.479345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:36.486615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:50:36.487667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 214/428] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:36.492919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.501246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639540a-bbc3-4200-ab3e-a1b19b619d72 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.505107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.505686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.505999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.506280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.506980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:36.507273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.532472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.540728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 215/429] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:36.546558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.558662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895d81-1595-43ad-96d9-ef07c93c1b5f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.563101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.563802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.564084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.564360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.575597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.601184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.618730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:36.619789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 215/430] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:36.625279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.634267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e00c1-6f7c-439e-8797-c0091028f881 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.638127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.639264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.639650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.639800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.640477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:36.640769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.665942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.679787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 216/431] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:36.684835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.693857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac26d7-115d-4d21-84b2-8b0e856eb53d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.698041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.698737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.699022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.699297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.712171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.738252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.759404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:36.760487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 216/432] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:36.766905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.775937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb76ce-4424-4915-b2b3-eb733d415d4f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.780461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.781089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.781376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.781654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.782465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:36.782761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.807619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.835900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 217/433] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:36.841122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.850874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf10c-feab-4dd5-b763-2ce9d0adef4f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.854777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.855283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.855570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.855850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.863225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.888117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.896865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 217/434] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:36.901905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.911322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72950494-6914-45c9-bc74-35b61eba139b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.915146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.915838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.916119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.916391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.927571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:36.953062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:36.970022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:36.971086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 218/435] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:36.976316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:36.984708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e08854-4352-43f0-9e67-310a33729bf6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:36.988603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:36.989179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:36.989466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:36.989746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:36.990460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:36.990758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:37.017144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:37.031223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 218/436] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:37.036825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:37.046162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e1b5-3741-482f-b814-e0d882a9c381 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:37.050059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:37.050760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:37.051048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:37.051328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:37.060065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:37.086714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:37.101145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:37.102279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 219/437] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:37.108028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:37.117161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf70928-9f51-4f5b-ac66-a8a36f9eba15 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:37.121314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:37.121898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:37.122214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:37.122494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:37.123745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:37.124048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:37.150110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf128a9-0790-48a9-b042-333c612d721c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:37.164173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 219/438] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:37.169956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:37.179287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e02ccf-73df-4b80-9066-b374b27d0a1a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:37.183281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:37.183860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:37.184147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:37.184427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:37.185205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:37.186160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:37.211886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2c630-4b49-4f1f-9ba8-8c6a2693e10c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:37.218161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 220/439] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:50:37 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:39.211191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d63d-9d11-4fcf-a7aa-15852afc21b8 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:39.211726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d63d-9d11-4fcf-a7aa-15852afc21b8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:39.211726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45d63d-9d11-4fcf-a7aa-15852afc21b8 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:39.213398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 220/440] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:39.219087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:39.219517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:39.219645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:39.241705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:39.242783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:39.249461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 221/441] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:39.271121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45d63d-9d11-4fcf-a7aa-15852afc21b8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:39.283307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45d63d-9d11-4fcf-a7aa-15852afc21b8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:39.287116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:39.287834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:39.288123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:39.288402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:39.289017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:39.314108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:39.314108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:39.314108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:39.314970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:39.327091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 09:50:39.328157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 221/442] 10.222.0.11 () {56 vars in 1153 bytes} [Wed Apr 6 09:50:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:39.333416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:39.342274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e5bc5-bc55-4d80-9e6f-450fc81b4ae7 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:39.346155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:39.346729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:39.347011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:39.347286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:39.347949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:39.348242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:39.372505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:39.372505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:39.372505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:39.374298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53924c37-81a8-4171-9115-416377e9fdc3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:39.378446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 222/443] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:39.383360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:39.392978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac447cf-b8a9-4fc2-a387-a4998a72a01d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:39.396849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:39.397406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:39.397693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:39.398006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:39.398668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:39.398964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:39.423071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:39.423071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:39.423071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:39.423935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6393-fdcd-46b7-9ff5-0bd6917cf471 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:39.428204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 222/444] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:41.395563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b2b9-07a3-48d1-8e5c-d1f4bddf9e3c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:41.396078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b2b9-07a3-48d1-8e5c-d1f4bddf9e3c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:41.396189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b2b9-07a3-48d1-8e5c-d1f4bddf9e3c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:41.397778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 223/445] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:41.402931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c65f3-652c-4699-84de-15c98f455528 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:41.403333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c65f3-652c-4699-84de-15c98f455528 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:41.403493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c65f3-652c-4699-84de-15c98f455528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:41.425836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-aa9c65f3-652c-4699-84de-15c98f455528 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:41.426964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-aa9c65f3-652c-4699-84de-15c98f455528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:41.433448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 223/446] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:41.455915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b2b9-07a3-48d1-8e5c-d1f4bddf9e3c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:41.467176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b2b9-07a3-48d1-8e5c-d1f4bddf9e3c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:41.470975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:41.471547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:41.471839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:41.472123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:41.472797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:41.497173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:41.497173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:41.497173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:41.498718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434ac74-e225-4e19-b4ae-82891918f761 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:41.588552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 224/447] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:50:41 2022] POST /identity/v3/services => generated 269 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:50:43.573009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef717-f09a-4f2a-a68c-a96202528187 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.573530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef717-f09a-4f2a-a68c-a96202528187 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.573615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cef717-f09a-4f2a-a68c-a96202528187 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.575284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 224/448] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:43.581244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.581645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.581817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.604248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:43.605369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:43.623805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 225/449] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:43 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:43.645806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cef717-f09a-4f2a-a68c-a96202528187 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:43.657858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cef717-f09a-4f2a-a68c-a96202528187 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:43.661698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:43.662446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.662741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.663022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.663648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:43.688381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:43.699185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 09:50:43.700232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 225/450] 10.222.0.11 () {56 vars in 1153 bytes} [Wed Apr 6 09:50:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:43.706444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:43.714785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c07bb-eae8-4045-ba40-b5b6cf8dec6c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:43.719505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:43.720118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.720408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.720689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.721363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:43.721659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:43.746141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:43.750353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 226/451] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:43.755527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:43.765608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20420-476e-41ed-8dcd-bdc9153bd0dc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:43.769544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:43.770148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.770444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.770730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.771397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:43.771700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:43.796587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:43.801125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 226/452] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:43.806573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:43.816246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f848cb-682f-41cc-9f8b-6e36be26ee06 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:43.820472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:43.821039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.821328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.821612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.822382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] RBAC: Adding query filter params (interface=public, service_id=0ea2091f7c6046d2b42e0aeab27015ce, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:43.822689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:43.847694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:43.847694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:43.847694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:43.848499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c5b39-f31f-4cd1-b692-0aff46c8289c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:43.854225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 227/453] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:50:43 2022] GET /identity/v3/endpoints?service_id=0ea2091f7c6046d2b42e0aeab27015ce&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:43.859100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:43.867958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c40ff-8f55-47b4-beff-f06a2127dbc8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:43.871935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:43.873053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:43.873394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:43.873680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:43.874364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:43.899249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed269cc3-b14f-4914-a3a2-e0f560a5fd6b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:43.904299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 227/454] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:50:43 2022] GET /identity/v3/services => generated 562 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:45.906168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6d04-fac4-4a42-9e1f-7ac87c516741 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:45.906713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6d04-fac4-4a42-9e1f-7ac87c516741 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:45.906713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6d04-fac4-4a42-9e1f-7ac87c516741 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:45.908410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 228/455] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:45.913499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:45.913883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:45.914108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:45.937389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:45.938535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:45.945401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 228/456] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:45 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:45.966709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf6d04-fac4-4a42-9e1f-7ac87c516741 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:45.978113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf6d04-fac4-4a42-9e1f-7ac87c516741 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:45.982599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:45.983521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:45.983810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:45.984089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:45.984711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:46.014862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:46.014862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:46.014862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:46.015774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:46.027670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 09:50:46.029408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 229/457] 10.222.0.11 () {56 vars in 1153 bytes} [Wed Apr 6 09:50:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:46.035238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:46.043665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd695b-95e8-48a8-906f-2a7d48c0b345 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:46.048464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:46.049042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:46.049331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:46.049612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:46.050320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:46.050621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:46.076752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:46.080993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 229/458] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:46.085968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:46.095419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9c2d-b5d4-4e72-aa93-1fc7d98a2dd5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:46.099244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:46.099809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:46.100094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:46.100370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:46.101027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:46.101318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:46.126702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9b5bd-0ef9-42cf-8805-09904a5792a9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:46.131273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 230/459] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:50:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:46.136519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:46.146378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f5bf-d97a-4f1d-9f4c-cfa7f76a9422 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:46.150300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:46.150867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:46.151156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:46.151440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:46.152152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:46.176436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:46.176436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:46.176436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:46.177245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426fa3-ce64-4827-a8a6-25997c8c0abe admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:46.257045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 230/460] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:50:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:50:48.224972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058654-9065-4119-8b25-488ba7916987 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:48.225486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058654-9065-4119-8b25-488ba7916987 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:48.225571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058654-9065-4119-8b25-488ba7916987 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:48.227276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 231/461] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:48.232835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:48.233248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:48.233336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:48.255987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:48.257096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:48.276607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 231/462] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:48 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:48.298490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02058654-9065-4119-8b25-488ba7916987 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:48.309790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02058654-9065-4119-8b25-488ba7916987 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:48.313635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:48.314376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:48.314662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:48.314942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:48.315559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:48.340431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:48.351310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 09:50:48.352328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 232/463] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:48.358217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:48.366482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0ea65-3cc9-4cab-9b74-b43971e59965 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:48.370373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:48.370944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:48.371231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:48.371511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:48.372176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:48.372812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:48.405505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149440c4-4feb-4093-850a-403fd84a587c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:48.410390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 232/464] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:48.415981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:48.426850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca4c4a-f5a8-4621-8bf9-c6976664299e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:48.430841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:48.431418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:48.431707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:48.431989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:48.432649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:48.432946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:48.461745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bfd5e-ab15-44f1-976b-b2a21ac23a39 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:48.467008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 233/465] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:50.451068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4e7a-b793-4e7f-8460-04d33511f181 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:50.451588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4e7a-b793-4e7f-8460-04d33511f181 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:50.451673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4e7a-b793-4e7f-8460-04d33511f181 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:50.453316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 233/466] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:50.460223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831eea5-5530-40cc-9892-860ef0378cba None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:50.460656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831eea5-5530-40cc-9892-860ef0378cba None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:50.460783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831eea5-5530-40cc-9892-860ef0378cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:50.483875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2831eea5-5530-40cc-9892-860ef0378cba None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:50.484979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2831eea5-5530-40cc-9892-860ef0378cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:50.491474 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 234/467] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:50 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:50.512544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4e7a-b793-4e7f-8460-04d33511f181 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:50.524912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4e7a-b793-4e7f-8460-04d33511f181 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:50.529542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:50.530172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:50.530460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:50.530740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:50.531403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:50.555750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:50.555750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:50.555750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:50.556624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dce4c-c78b-45fd-b295-7694f508c298 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:50.634487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 234/468] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:50:50 2022] POST /identity/v3/services => generated 242 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:50:52.625632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c14ae-c343-425e-b2f6-d1a0bf3fe54f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.626253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c14ae-c343-425e-b2f6-d1a0bf3fe54f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.626400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c14ae-c343-425e-b2f6-d1a0bf3fe54f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.628465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 235/469] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:52.634163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.634594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.634865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.658026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:52.659158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:52.675475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 235/470] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:52 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:52.697162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c14ae-c343-425e-b2f6-d1a0bf3fe54f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:52.709076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c14ae-c343-425e-b2f6-d1a0bf3fe54f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:52.712913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:52.713618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.713906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.714213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.714840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:52.740132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:52.750451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 09:50:52.751487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 236/471] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:52.757025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:52.766026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e0ad-397c-4231-978c-a273408f55e7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:52.769963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:52.770559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.770847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.771127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.771796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:52.772097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:52.797691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:52.801969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 236/472] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:52.807146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:52.816653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587cf7-15f5-491f-ac36-a39424b5c7e3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:52.820842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:52.821411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.821701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.822017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.822682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:52.822982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:52.848217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:52.852776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 237/473] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:52.858183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:52.866999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839e15e-0c5c-41ae-ac6d-e00e542125aa admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:52.870886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:52.871446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.871736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.872546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.873378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] RBAC: Adding query filter params (interface=public, service_id=c72bd9448274459abe557c670d4c8425, region_id=RegionOne) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:52.873682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:52.898479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:52.898479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:50:52.898479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:50:52.899279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e1c7f-d20e-4464-9fb5-0a93d83a7180 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:52.905006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 237/474] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:50:52 2022] GET /identity/v3/endpoints?service_id=c72bd9448274459abe557c670d4c8425&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:52.909851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:52.918720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9a47-d68f-42dd-9dca-8ae50158ee0d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:52.922652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:52.923220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:52.923508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:52.923789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:52.924426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:52.951914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094c2b2-3604-47ec-ac72-706194f358cf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:52.956962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 238/475] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:50:52 2022] GET /identity/v3/services => generated 792 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:54.947603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28edec-6a94-4427-9b73-8d2b2cf2ca52 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:54.948143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28edec-6a94-4427-9b73-8d2b2cf2ca52 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:54.948254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28edec-6a94-4427-9b73-8d2b2cf2ca52 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:54.949951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 238/476] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 09:50:54.955584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:54.956031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:54.956130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:54.978981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:54.980095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:54.987120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 239/477] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:54 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:55.008910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28edec-6a94-4427-9b73-8d2b2cf2ca52 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:55.021250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28edec-6a94-4427-9b73-8d2b2cf2ca52 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:55.024996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:55.025696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:55.026006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:55.026284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:55.026896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:55.053260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:55.064228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 09:50:55.065267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 239/478] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:55.070998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:55.079908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696f1a-6548-48b7-9698-59c37c277c45 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:55.083850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:55.084420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:55.084703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:55.084980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:55.085648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:55.085965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:55.110481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:55.114712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 240/479] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:55.119810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:55.129489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37404-6633-4e08-b091-a8460908c5c5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:55.133403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:55.134000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:55.134290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:55.134572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:55.135237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:55.135534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:55.161299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791e24-e72d-4855-9583-3dcccf2f0024 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:55.165823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 240/480] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:50:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:55.171012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:55.179950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869201dd-b455-4467-98ea-7ece71a95572 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:55.183843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:55.184900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:55.185187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:55.185468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:55.186184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:55.210922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:50:55.210922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:50:55.210922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:50:55.211732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5d66d-13f9-4032-b5d3-0e37f47f6d11 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:55.322667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 241/481] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:50:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:50:57.366993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba12d3-7855-43b9-9fee-5a70836b53f4 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.367528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba12d3-7855-43b9-9fee-5a70836b53f4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.367625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba12d3-7855-43b9-9fee-5a70836b53f4 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.369216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 241/482] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:50:57.374937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.375354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.375514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.397946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:50:57.399081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:50:57.414754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 242/483] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:50:57 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:50:57.437127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba12d3-7855-43b9-9fee-5a70836b53f4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.448694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba12d3-7855-43b9-9fee-5a70836b53f4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.453080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.453794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.454120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.454403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.466415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:50:57.473232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:50:57.474350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 242/484] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:57.479697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.488108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e9bf7-fc29-44ab-9a3d-605ab16e28f1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.492087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.492670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.492959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.493239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.493971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:57.494276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.520064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.528802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 243/485] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:57.534060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.542980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d0c6-c964-4341-922e-409146a929ac admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.547499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.548188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.548474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.548752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.560109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.585427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.602092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:57.603119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 243/486] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:50:57.609019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.618108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea199c5-796e-4d6b-a6f4-2693b2a84994 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.622080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.622658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.622949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.623232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.623920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:57.624223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.649388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.662478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 244/487] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:57.667510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.676530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1850-548e-4fbd-97b9-f3dbe26db2ed admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.680323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.681012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.681300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.681579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.694805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.721380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.738552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:50:57.739602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 244/488] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:57.744954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.754234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472ca67-b602-49b2-a4ef-d256be6258ba admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.758235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.758820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.759111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.759394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.760177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:57.760479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.786607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.815805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 245/489] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:50:57.821419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.831141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0791-12b0-4606-bb80-3b693b0ef567 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.835077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.835641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.835930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.836210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.844444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.869590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.880560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 245/490] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:50:57.885771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.895636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f1d-f020-4548-858d-834d8af8a626 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.899496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.900188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.900468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.900742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.912440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:57.936960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:57.954276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:50:57.955382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 246/491] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:57.960600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:57.969829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d925f4-62a3-4969-a9bf-6f2431ed5240 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:57.973856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:57.974466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:57.974758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:57.975042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:57.975727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:57.976025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:58.002174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:58.019805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 246/492] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:58.025366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:58.035479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a2618-61fd-4886-b735-3603c0f191ad admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:58.039377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:58.040084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:58.040370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:58.040647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:58.049604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:58.075762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:58.095586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:50:58.096651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 247/493] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:50:58.102311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:58.111444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357614-f108-4c5b-8588-8c52610005be admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:58.115381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:58.115959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:58.116250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:58.116531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:58.117269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:58.117568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:58.143801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8383d6d-f997-4eab-ba2a-09afc1b6f906 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:58.156457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 247/494] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:50:58.161944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:50:58.171364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1cf7-2360-458f-98ae-e5d21ccadf36 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:50:58.175198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:50:58.175756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:50:58.176040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:50:58.176315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:50:58.177084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] RBAC: Adding query filter params (role.id=e5ec215ce8024dde8601defe84e3cdaf, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:50:58.177385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:50:58.204433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56177e7-e1e1-48a2-9537-1d45c5da4ea0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:50:58.209523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 248/495] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:50:58 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=e5ec215ce8024dde8601defe84e3cdaf => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.162470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2da3-ad3b-4bc8-b69d-a9b5576bdbe3 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.162974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2da3-ad3b-4bc8-b69d-a9b5576bdbe3 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.163088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2da3-ad3b-4bc8-b69d-a9b5576bdbe3 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.164687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 248/496] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:00.170672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.171097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.171245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.194476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:00.195612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:00.202363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 249/497] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:00 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:00.223961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2da3-ad3b-4bc8-b69d-a9b5576bdbe3 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.235960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2da3-ad3b-4bc8-b69d-a9b5576bdbe3 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.239703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.240415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.240698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.240972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.252402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:00.259138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:51:00.260219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 249/498] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:00.265801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.274316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69d94-a3a9-44e9-84b7-7d634ad300c7 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.278789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.279369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.279655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.279933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.280639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:00.280939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.306089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.314466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 250/499] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.320882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.330543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eaa43-bf68-4b8d-ac5d-a64ce626f8ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.334456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.335143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.335428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.335704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.347115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.372789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.389768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:00.390836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 250/500] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:00.396009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.405508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810720e-f06c-4379-a8fa-0156165f715e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.409439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.410052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.410341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.410623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.411312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:00.411613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.437035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.449670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 251/501] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.454777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.463730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745756f9-8693-421a-8aca-99262b001636 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.468173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.468856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.469139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.469415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.482269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.507736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.525313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:51:00.526417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 251/502] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:00.532553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.541705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7dfa-b8cd-4ac8-a58d-3bf19d28da5a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.546681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.547266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.547555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.547838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.548621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:00.548924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.574113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.602439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 252/503] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.608333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.617233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9868eb-e6ff-49f4-b9fc-d10fd1df3582 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.621069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.621950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.622331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.622614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.634366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.660105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.676307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:00.677384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 252/504] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:00.682821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.691930 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75013f-ff0e-4c23-bd67-f9829165806e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.696070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.696646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.696932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.697204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.697879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:00.698203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.723797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.735784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 253/505] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.741100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.750284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a804-cc6e-4eea-bbe7-365125b7ac4e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.754184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.754879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.755169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.755454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.765124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.790886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.804166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:00.805200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 253/506] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:00.810675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.820114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43d78-ce29-434d-b886-29c5ea072b88 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.824053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.824623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.825400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.825679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.826449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:00.826752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.852133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7d023-d020-43dc-bd33-57d5975a4284 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:00.864864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 254/507] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:00.870254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:00.879247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677863-81e8-4ff5-9144-12d5289fe402 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:00.883122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:00.883914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:00.884199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:00.884480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/e5ec215ce8024dde8601defe84e3cdaf` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:00.886465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=7be23285393b46bfb3a98e839c603cb6, role_id=e5ec215ce8024dde8601defe84e3cdaf)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:00.913218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b073-5471-402c-9126-899a23138bd9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:01.019948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 254/508] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:51:00 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/7be23285393b46bfb3a98e839c603cb6/roles/e5ec215ce8024dde8601defe84e3cdaf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:51:02.978846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc4bb-067b-4cd4-a0eb-d656d396dd61 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:02.979426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc4bb-067b-4cd4-a0eb-d656d396dd61 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:02.979426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bc4bb-067b-4cd4-a0eb-d656d396dd61 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:02.981600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 255/509] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:02.986663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:02.987082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:02.987237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.009087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:03.010233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:03.072400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 255/510] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:02 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:51:03.095165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bc4bb-067b-4cd4-a0eb-d656d396dd61 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.107008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bc4bb-067b-4cd4-a0eb-d656d396dd61 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.110817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.111530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.111812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.112088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.123319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:03.130054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:51:03.131106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 256/511] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:03.136420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.145227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74bd2-33fe-42df-99e5-289b09f5be00 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.149175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.149758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.150084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.150369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.151077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.151374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.176813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.185020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 256/512] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:03.190124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.200724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef709-b9f9-4d70-a4ec-b7d8b097dbbc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.204670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.205348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.205632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.205908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.217725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.242939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.260712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:03.261746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 257/513] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:03.267601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.276543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb199eb-0ff1-45cd-add0-aa77400503ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.280529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.281130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.281416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.281695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.282410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.282710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.307416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.320465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 257/514] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:03.326040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.334919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccbf81-891d-472c-878d-b5db13a80a82 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.338789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.339478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.339761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.340039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.352460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.378813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.397331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 09:51:03.398452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 258/515] 10.222.0.11 () {56 vars in 1114 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:03.404371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.413587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d1f4-ea25-486c-b2b4-6cc01ab6c77d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.417555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.418170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.418463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.418744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.419534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.419834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.445687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.476539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 258/516] 10.222.0.11 () {56 vars in 1154 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:03.482291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.491533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81182-aefc-4c1a-9901-021da57767e6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.495609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.496122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.496918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.497198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.504838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.530142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.538441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 259/517] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:03.544276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.553377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cfd47-2413-4272-b104-40846db12860 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.557446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.558238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.565577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.565577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.571336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.597570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.614244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:03.615298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 259/518] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:03.620793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.630153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1987a-04f7-45c0-bc91-f4a121e970d3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.634083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.634653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.634937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.635216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.635930 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.636227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.662386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.677077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 260/519] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:03.682523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.691660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150908-6dbc-448e-a0a2-3e661688c824 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.695886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.696586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.696871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.697149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.706711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.732865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.747262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:03.748309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 260/520] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:03.754022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.763751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9574f1-659d-406e-8413-fe52ac35f801 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.767674 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.768244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.768527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.768802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.769728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.770137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.795403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52328e-3647-440e-a111-32ed60f69558 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.807980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 261/521] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:03.817741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:03.828002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7084a-285a-41fb-bb7b-3f94a8ae0f2a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:03.831908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:03.832473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:03.832755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:03.833033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:03.833806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] RBAC: Adding query filter params (role.id=e5ec215ce8024dde8601defe84e3cdaf, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=7be23285393b46bfb3a98e839c603cb6) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:03.834139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:03.861162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db018c-e920-4ecb-be5e-c395958fb490 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:03.866681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 261/522] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:03 2022] GET /identity/v3/role_assignments?user.id=7be23285393b46bfb3a98e839c603cb6&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=e5ec215ce8024dde8601defe84e3cdaf => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:05.933443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a4199-2bbd-4f1c-a2cd-ccd4c68582c0 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:05.934018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a4199-2bbd-4f1c-a2cd-ccd4c68582c0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:05.934105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a4199-2bbd-4f1c-a2cd-ccd4c68582c0 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:05.936334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 262/523] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:05.941414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:05.941811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:05.942003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:05.964564 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:05.966161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:05.972753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 262/524] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:05 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:51:05.996144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a4199-2bbd-4f1c-a2cd-ccd4c68582c0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:06.008000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a4199-2bbd-4f1c-a2cd-ccd4c68582c0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:06.011777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:06.012512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:06.012789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:06.013062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:06.024264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:06.053181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:06.071460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:06.072568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 263/525] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:06.078601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:06.087046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7f6f5-4ba4-4b59-8bcc-1617d8fb1ff2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:06.091482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:06.092050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:06.092332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:06.092606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:06.093283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:06.093576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:06.118834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019852-d317-43ab-b671-090fbe038ada admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:06.131840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 263/526] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:06.137804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:06.146794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268ae6e-ef42-4f7b-9476-4d38ef5e962f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:06.150654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:06.151230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:06.151519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:06.151794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:06.152427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:06.178008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424597-e903-4741-a782-2c9c9698ef52 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:06.273674 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 264/527] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:51:06 2022] POST /identity/v3/users => generated 248 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:51:08.254195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5cf3-3e2a-4d04-b432-72cc2a2dcc10 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.254742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5cf3-3e2a-4d04-b432-72cc2a2dcc10 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.254742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5cf3-3e2a-4d04-b432-72cc2a2dcc10 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.256379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 264/528] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:08.261409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.262298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.262570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.284539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:08.285654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:08.292268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 265/529] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:08 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:08.313747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5cf3-3e2a-4d04-b432-72cc2a2dcc10 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.326304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5cf3-3e2a-4d04-b432-72cc2a2dcc10 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.330211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.330921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.331213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.331498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.342876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:08.349231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:08.350334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 265/530] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:08.356237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.364701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeab81-360f-4bf5-9934-3e3dbaf88447 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.368612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.369194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.369481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.369759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.370498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:08.370796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.403548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.416065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 266/531] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:08.422046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.431657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a411-c377-41c3-a5c7-1d35cf4764f3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.436283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.436983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.437271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.437551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.448711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.473641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.491236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:08.492287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 266/532] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:08.498209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.507246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852040c-603e-4c3e-9a56-ff5a6fccda52 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.511288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.511939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.512256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.512543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.513226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:08.513526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.542744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.556410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 267/533] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:08.561917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.571319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a0ea-f088-4221-85ca-c8c90647bf95 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.575492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.576198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.576485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.576765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.589010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.615367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.632441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 09:51:08.633484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 267/534] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:08.638830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.647756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48ea3b-384f-4920-ada3-6254613bb906 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.651683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.652261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.653363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.653473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.654285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:08.654580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.680244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.708681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 268/535] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:08.714276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.724112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920230-a8de-4142-baf4-d7b8c5682b07 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.728124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.728690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.728978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.729260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.737261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.762429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.770665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 268/536] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:08.776093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.785654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663382-0d45-4cd4-b286-8b2c758d488a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.790031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.790732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.791014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.791289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.803390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.828611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.845469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:08.846545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 269/537] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:08.851921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.860959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11c3b1-34c7-4678-8a4d-2ee52f9310f5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.865192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.865780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.866097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.866383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.867065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:08.867361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.893046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.906368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 269/538] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:08.911460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.920623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7679c-5167-4b3e-9979-e55ee161ecdf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.924554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.925242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.925545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.925803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.934764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:08.960630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:08.974770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:08.975844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 270/539] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:08.981403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:08.990678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fd07c-24d1-4de5-bdff-440d95ea30c7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:08.994725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:08.995305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:08.995595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:08.995880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:08.996705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:08.997014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:09.022971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40a820-cabf-4030-b552-a5bdaa4c3225 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:09.036156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 270/540] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:09.041647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:09.050913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bc7f-6da1-4634-a324-b0759a66a7c7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:09.054790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:09.055355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:09.055640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:09.055916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:09.056679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=91fdfcc74542409cb3c1b0ac2ea8c052) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:09.056979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:09.082966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb3b3b-9906-4909-bcf3-16f9443fc8ce admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:09.088315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 271/541] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:09 2022] GET /identity/v3/role_assignments?user.id=91fdfcc74542409cb3c1b0ac2ea8c052&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:11.049445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9f40-4899-4e7d-bb5b-6844797353b6 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.049990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9f40-4899-4e7d-bb5b-6844797353b6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.050105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9f40-4899-4e7d-bb5b-6844797353b6 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.051709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 271/542] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:11.056742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.057153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.057306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.080577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:11.081684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:11.088220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 272/543] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:11 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:11.109900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9f40-4899-4e7d-bb5b-6844797353b6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.121713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9f40-4899-4e7d-bb5b-6844797353b6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.125598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.126334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.126629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.126913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.138473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:11.144829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:11.145908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 272/544] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:11.151390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.160087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29265128-3f90-4f9d-a373-ce7b7f0163ff None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.164047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.164627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.164913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.165191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.165892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:11.166224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.192169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.200865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 273/545] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:11.206199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.215719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d3e91-5158-40bf-9d7a-2eab587c9921 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.219734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.220428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.220718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.221002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.233034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.258586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.275856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:11.276908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 273/546] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:11.282389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.291380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642a03-2d89-409c-93d8-717188a60835 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.295966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.296539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.296827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.297104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.297787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:11.298123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.323584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.336269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 274/547] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:11.341769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.350818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38b361-ee56-43ed-a32f-bded24b8685b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.354731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.355943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.356231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.356513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.370375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.395996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.412828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 09:51:11.413857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 274/548] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:11.420067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.429019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055163e-ea80-4171-81d7-7c381558a3d4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.432876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.433454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.434795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.435107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.435887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:11.436187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.461410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.491806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 275/549] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:11.497575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.506612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444112a-9fe9-4488-bcf1-1f5af49b3e89 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.510570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.511268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.511555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.511978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.524001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.550144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.566262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:11.567298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 275/550] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:11.572731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.582195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e461e-a414-418e-9458-063107930145 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.586109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.586680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.586963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.587240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.587910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:11.588202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.614459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.626329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 276/551] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:11.631433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.640336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d1d66-d562-455f-8bbd-65e002748bcf admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.644264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.644956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.645241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.645520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.654746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.679777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.693611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:11.694914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 276/552] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:11.700435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.709382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4f31-999c-4c8d-96ab-45ce40c421a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.713321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.713888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.714205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.714484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.715816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:11.716111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.741233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d6dc-36f7-4a26-813d-a67918fe7c3a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.754524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 277/553] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:11.759758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:11.768811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede3656-5c76-41e4-8dc5-994ed1019f33 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:11.772721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:11.773507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:11.773793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:11.774107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/91fdfcc74542409cb3c1b0ac2ea8c052/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:11.795047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=91fdfcc74542409cb3c1b0ac2ea8c052, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:11.820862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d5941-1bf4-4eb0-a75d-4bfba25f3dd4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:11.908153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 277/554] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:51:11 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/91fdfcc74542409cb3c1b0ac2ea8c052/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:51:13.868202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570342-8950-4e86-8d32-9f7de2b10034 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:13.868723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570342-8950-4e86-8d32-9f7de2b10034 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:13.868810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570342-8950-4e86-8d32-9f7de2b10034 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:13.870472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 278/555] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:13.876235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:13.876669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:13.876803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:13.899191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:13.900306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:13.962210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 278/556] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:13 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:13.984708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570342-8950-4e86-8d32-9f7de2b10034 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:13.996919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570342-8950-4e86-8d32-9f7de2b10034 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.000733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.001436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.001721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.002035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.013489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:14.019922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:14.020993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 279/557] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:14.026581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.035118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013074c-93a6-4757-885f-8ae782f8f657 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.039067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.039663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.039954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.040237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.040944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.041242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.066668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.075645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 279/558] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:14.080745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.090510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a81ca-9d5d-4faf-8299-d3a45bd112a6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.094471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.095159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.095445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.095723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.106997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.132525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.150066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:14.151109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 280/559] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:14.156785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.165841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fc9f-1e07-47ce-8446-3166bffdcf64 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.170439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.171012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.171300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.171579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.172259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.172556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.198359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.210635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 280/560] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:14.216382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.231848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece378e-d32f-4410-9c84-6a7de8914619 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.235808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.236502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.236790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.237065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.250313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.280670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.299558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 09:51:14.300642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 281/561] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:14.306502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.316231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b38fd-26b9-4fc5-b23a-539f38953557 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.320495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.321078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.321364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.321645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.322459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.322758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.348046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.376892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 281/562] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:14.382339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.391420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c80421-56b6-47d9-b8b7-5d62ca98359e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.395264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.395829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.396117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.396397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.403890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.429485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.438484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 282/563] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:14.444146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.453282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b2b22-cddb-40d0-99aa-21f6a635a5a1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.457287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.458035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.458325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.458610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.469897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.495683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.513217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:14.514293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 282/564] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:14.519504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.528320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5659-6c90-4b29-8169-380a6322051c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.532281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.532850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.533137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.533418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.534129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.534428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.560333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.573500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 283/565] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:14.578992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.587965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0dd8c-7c8e-4664-a98e-20cf3ce64006 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.592430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.593127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.593417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.593689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.602326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.628125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.641162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:14.642286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 283/566] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:14.647505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.657310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731355c-ec9a-489f-8885-a588122fb138 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.661197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.661765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.662086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.662365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.663095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.663393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.689126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6154f16-1017-40a4-b421-38abc374ddbc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.701946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 284/567] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:14.707414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:14.717297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd049fd-cd8c-4e56-b1c4-ce82d0f4e052 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:14.721304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:14.721861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:14.722175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:14.722452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:14.723219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=91fdfcc74542409cb3c1b0ac2ea8c052) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:14.723517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:14.750043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa9eae-6c88-444f-b80d-3a61b6a2c163 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:14.755860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 284/568] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:14 2022] GET /identity/v3/role_assignments?user.id=91fdfcc74542409cb3c1b0ac2ea8c052&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:16.748910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3b1d-f2e4-4474-96c7-a0a6d9b35528 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:16.749436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3b1d-f2e4-4474-96c7-a0a6d9b35528 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:16.749550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3b1d-f2e4-4474-96c7-a0a6d9b35528 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:16.751209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 285/569] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:16.756124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:16.756493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:16.756690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:16.780483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:16.781598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:16.788150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 285/570] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:16 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:16.812016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3b1d-f2e4-4474-96c7-a0a6d9b35528 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:16.823632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3b1d-f2e4-4474-96c7-a0a6d9b35528 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:16.827734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:16.828437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:16.828726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:16.829008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:16.841238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:16.866666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:16.883216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:16.884261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 286/571] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:16.890210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:16.898570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e287-ff97-413c-ba2f-8a2b6ab6830c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:16.903061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:16.903635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:16.903927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:16.904208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:16.904893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:16.905192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:16.930454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12821d30-462d-4e3f-984d-7ebf07997d6d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:16.942971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 286/572] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:16.948700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:16.957764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e601a-bb05-4d35-b0c4-265edb6db93f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:16.961669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:16.962278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:16.962567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:16.962845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:16.963487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:16.989607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1c815-a20f-4e63-b7c6-ea62e0a28609 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:17.080850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 287/573] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:51:16 2022] POST /identity/v3/users => generated 254 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:51:19.087698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31f8c-6457-4918-a940-6cc047f77e31 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.088234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31f8c-6457-4918-a940-6cc047f77e31 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.088322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31f8c-6457-4918-a940-6cc047f77e31 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.089982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 287/574] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:19.095015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.095411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.095578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.116983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:19.118138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:19.125581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 288/575] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:19 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:19.147525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31f8c-6457-4918-a940-6cc047f77e31 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.159007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31f8c-6457-4918-a940-6cc047f77e31 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.162831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.163574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.163864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.164144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.175289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:19.181557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:19.182639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 288/576] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:19.189058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.197607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df2306-cf26-45c0-b446-9399236714c0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.202743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.203322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.203608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.203885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.204582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.204878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.229830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.238341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 289/577] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:19.243436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.253545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490e89-1613-4c33-8b9e-7c5d75515e29 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.257552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.258290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.258573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.258851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.269792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.295869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.312761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:19.313803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 289/578] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:19.319281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.328594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca875a0-7ae0-41e9-b05d-0231fb3d430b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.332552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.333118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.333400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.333675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.334377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.334675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.366035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.388170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 290/579] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:19.393679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.403511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc7ac-0fbb-4712-8ddf-9f1b37d490de admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.407552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.408273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.408561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.408841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.421119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.446483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.465531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:19.466675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 290/580] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:19.472420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.481731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdce1b0-e9e1-4942-b4dc-670a597ab472 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.485703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.486331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.486625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.486906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.487692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.487996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.513976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.543566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 291/581] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:19.548986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.558137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff585a3-3bc1-4cb8-beda-c8871b33bf2a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.562181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.562744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.563032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.563312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.570956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.597208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.605602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 291/582] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:19.610859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.619846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814908c-d0f4-40db-8d98-de1d314dfd93 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.624312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.625013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.625301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.625582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.637414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.662640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.679246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:19.680289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 292/583] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:19.685567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.694206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e8740-d123-4880-87cc-2df479853013 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.698213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.699397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.699397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.699824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.700494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.700793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.726324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.739664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 292/584] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:19.745166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.754463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b476374-0e1a-4ae6-a6e8-b8151eb2b09f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.758492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.759198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.759487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.759769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.769253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.794925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.808727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:19.809769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 293/585] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:19.815161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.825158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814a35c-b659-445a-a836-2b9a9ded5c4f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.829098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.829671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.829988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.830272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.831009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.831313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.856305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d6035-1fab-440e-9d03-23c77afb1ace admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.868913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 293/586] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:19.875437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:19.884406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745078ce-e2d1-44eb-9d45-d38207a7e5f4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:19.889426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:19.890014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:19.890304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:19.890580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:19.891343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=b0f2d90de9d44b48a4d92f9380861ceb) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:19.891642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:19.916875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528c-8eab-45c0-a5ba-66954e86b3e6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:19.922516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 294/587] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:19 2022] GET /identity/v3/role_assignments?user.id=b0f2d90de9d44b48a4d92f9380861ceb&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:21.911774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138d8b8-bc8d-450a-a6e6-856c5cd30c87 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:21.912325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138d8b8-bc8d-450a-a6e6-856c5cd30c87 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:21.912325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138d8b8-bc8d-450a-a6e6-856c5cd30c87 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:21.914007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 294/588] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:21.919829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:21.920239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:21.920396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:21.943216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:21.944585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:21.951221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 295/589] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:21 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:51:21.972385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138d8b8-bc8d-450a-a6e6-856c5cd30c87 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:21.984369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138d8b8-bc8d-450a-a6e6-856c5cd30c87 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:21.988200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:21.988912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:21.989200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:21.989479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.001364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:22.008031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:22.009117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 295/590] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:22.014876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.023373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163549d5-808d-40cd-ae14-ffe5c84ff8fd None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.027900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.028485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.028775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.029057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.029765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:22.030107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.055232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.063439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 296/591] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:22.068797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.078494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da26736-c7c6-4244-8f91-bc59b044dbe9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.082461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.083148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.083435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.083721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.095172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.121100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.138741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:22.139788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 296/592] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:22.144987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.154350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d194-f4c2-4919-aac7-129ea6ff8971 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.158349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.158920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.159205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.159483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.160158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:22.160454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.185796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.198397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 297/593] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:22.204638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.213586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dfe1c-0ffd-410e-b18e-4df38f510454 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.217985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.218700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.218985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.219267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.231707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.257565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.275877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:22.277009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 297/594] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:22.282398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.291566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0385ad-82d6-4045-8a22-9442e7d9d7f5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.295624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.296202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.296485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.296761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.297539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:22.297836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.324188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.351903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 298/595] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:22.357203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.366297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3de01-7bcc-4b67-9ed2-7338432ea4c5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.370273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.371608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.371901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.372183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.384118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.409903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.426836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:22.427876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 298/596] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:22.433196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.442756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33706-16d0-4b1f-ad6f-7b8ae22c4fa0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.446833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.447403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.447686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.447962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.448958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:22.449258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.473968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.486078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 299/597] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:22.491200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.501582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053dcc-fd7e-477b-b7f8-d78b409005c8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.505561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.506304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.506593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.506894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.515804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.540945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.554795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:22.555840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 299/598] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:22.561737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.570927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aacbde-93d0-4a93-a432-9cc93afb222e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.575596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.576861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.576861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.576861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.578067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:22.578067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.603130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8f8c3-7618-4266-8f26-74686dd45df2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.617017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 300/599] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:22.624384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:22.633614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c9fd2-4020-4252-9fdb-b418ecfd9528 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:22.637801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:22.638663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:22.638952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:22.639234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/b0f2d90de9d44b48a4d92f9380861ceb/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:22.660694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=b0f2d90de9d44b48a4d92f9380861ceb, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:22.687652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9eb5c-f5f7-4489-a868-d7545f3122b1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:22.755130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 300/600] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:51:22 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/b0f2d90de9d44b48a4d92f9380861ceb/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:51:24.750508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1a95-f881-477d-9d69-9f6a0c5e125a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:24.751061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1a95-f881-477d-9d69-9f6a0c5e125a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:24.751061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1a95-f881-477d-9d69-9f6a0c5e125a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:24.752758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 301/601] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:24.759334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:24.759805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:24.759902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:24.784137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:24.786246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:24.859075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 301/602] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:24 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:24.886671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1a95-f881-477d-9d69-9f6a0c5e125a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:24.901131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1a95-f881-477d-9d69-9f6a0c5e125a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:24.906778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:24.907973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:24.908593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:24.908985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:24.925317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:24.932610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:24.935563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 302/603] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:24.941147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:24.951552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcef0-19fc-491a-a330-17ef8755bea4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:24.956428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:24.957142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:24.957313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:24.957593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:24.958359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:24.958657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:24.991652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.003354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 302/604] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:25.010733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.022096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106d48-766f-4573-8f68-c738fece2df9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.026270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.027575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.027861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.028140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.039753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.067737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.088846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:25.090513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 303/605] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:25.099586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.111645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7fd47-2e77-4c1f-8f45-d4d17de19edf admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.118312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.119339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.119862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.120431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.121396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:25.121703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.146831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.160295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 303/606] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:25.165764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.176140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5352de-1935-4b27-b907-b6eea3fafa14 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.180159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.180883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.181175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.181458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.194263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.220295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.238437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:25.239481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 304/607] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:25.245100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.254399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ce16e-c591-47c5-bafc-4b18ff9b4ce6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.258361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.258946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.259278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.259562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.260341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:25.260640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.286355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.314718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 304/608] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:25.320337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.329798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596028b-62be-4bf7-bce3-e950c56ead93 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.333709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.334306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.334590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.334866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.343224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.368884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.377477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 305/609] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:25.382623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.392018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d98a2-65a0-42f9-994d-01e4a9f867a6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.395969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.396670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.396955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.397235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.409047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.434703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.451949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:25.452996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 305/610] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:25.458302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.467880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80782-7677-4a44-bb91-7cc3b561cde7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.471884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.472456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.472737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.473013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.473680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:25.474007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.500592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.514965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 306/611] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:25.520058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.529320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48f1bd-ecfd-4afe-9fa2-afbae17a2cff admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.533249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.533970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.534263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.534542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.543838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.569906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.583175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:25.584204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 306/612] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:25.589539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.598574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afbce-4d9a-4435-902b-c9c3ee831121 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.602606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.603178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.603467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.603747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.604482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:25.605305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.630812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48f89c-d5d4-48c6-88c9-1ebbbe943d0d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.643476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 307/613] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:25.648863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:25.657834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c029c-3394-40b7-8c92-75fb6d7189bb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:25.661771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:25.662389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:25.662677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:25.662955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:25.663724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=b0f2d90de9d44b48a4d92f9380861ceb) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:25.664026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:25.690373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b13db-a895-4ce5-bd2e-f77cd0986800 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:25.696106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 307/614] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:25 2022] GET /identity/v3/role_assignments?user.id=b0f2d90de9d44b48a4d92f9380861ceb&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:27.741704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66f3a-3340-4900-a4ee-32f6ecf1fc31 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.742316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66f3a-3340-4900-a4ee-32f6ecf1fc31 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.742316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66f3a-3340-4900-a4ee-32f6ecf1fc31 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.743996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 308/615] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:27.750026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.750455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.750596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.772477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:27.773580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:27.780271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 308/616] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:27 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:27.802615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66f3a-3340-4900-a4ee-32f6ecf1fc31 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:27.814561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66f3a-3340-4900-a4ee-32f6ecf1fc31 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:27.818608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:27.819320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.819610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.819885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.830849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:27.837555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:51:27.838633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 309/617] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:51:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:27.843987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:27.852358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2e694-b0ed-45fe-8ea8-d692fd931b31 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:27.856846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:27.857418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.857703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.858006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.858710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:27.859002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:27.884715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:27.892818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 309/618] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:51:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:27.898134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:27.907652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9e30-ab0b-47d1-a04b-aa48a07c30c6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:27.911576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:27.912254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.912539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.912818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.924131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:27.950412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:27.967660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:27.968720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 310/619] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:27.974259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:27.983879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce9bb-7b7c-4a0a-b899-1c7c01cb7ccf admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:27.987845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:27.988420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:27.988707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:27.988987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:27.989664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:27.989990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.016500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.029682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 310/620] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:28.034935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.045021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a77c5-f8d9-4e1c-8d48-c78770d407f7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.049059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.049773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.050095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.050373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.063192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.088587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.107983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:28.109016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 311/621] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:28.114432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.123834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197c0f-9874-49b0-a55a-f77a26077cf5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.127883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.128461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.128748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.129028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.129806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:28.130136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.156784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.187408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 311/622] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:28.192809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.202560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fee4-6131-4050-a8db-c02bf3c3109b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.206695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.207257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.207540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.207817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.215813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.241161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.249405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 312/623] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:28.254620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.263530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd7b7-2966-4dfc-a08c-fa8b285d9c43 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.267519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.268164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.268444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.268720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.280368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.305793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.322341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:28.323496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 312/624] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:28.328570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.336820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9814a2-0097-4a14-8285-f5d34c0478e8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.341339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.341910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.342220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.342499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.343167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:28.343487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.368488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.381007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 313/625] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:28.386899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.395811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb7fb-c47e-41ca-aafe-bc56540aab10 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.399757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.400449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.400735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.401018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.410278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.435593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.449526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:28.450605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 313/626] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:28.455910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.464931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58233d9-a80c-4efd-a3ee-f1089468ee87 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.468813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.469377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.469666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.469958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.470693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:28.470988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.496712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb665d-4566-426f-a113-bb8f467bdcdc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.509095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 314/627] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:28.514859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:28.523903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0573d4c-c5e3-4543-87f8-e8e4eb57aedb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:28.528221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:28.528783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:28.529068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:28.529347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:28.530145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] RBAC: Adding query filter params (role.id=e5ec215ce8024dde8601defe84e3cdaf, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=b0f2d90de9d44b48a4d92f9380861ceb) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:28.530445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:28.557396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b78ef-c8a2-4149-8b8f-fa9e279add4d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:28.563683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 314/628] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:28 2022] GET /identity/v3/role_assignments?user.id=b0f2d90de9d44b48a4d92f9380861ceb&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=e5ec215ce8024dde8601defe84e3cdaf => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:30.498443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa723-107d-469a-994e-f341c6606f05 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.498987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa723-107d-469a-994e-f341c6606f05 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.498987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa723-107d-469a-994e-f341c6606f05 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.500655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 315/629] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:30.505577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.505972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.506180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.529494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:30.530647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:30.537162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 315/630] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:30 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:30.559766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa723-107d-469a-994e-f341c6606f05 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.571214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa723-107d-469a-994e-f341c6606f05 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.576059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.576767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.577052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.577328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.588106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:30.595324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:51:30.596374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 316/631] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:30.601795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.612613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e2821-7956-4d95-91c3-00ddb0b544d5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.616926 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.617521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.617811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.618151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.618876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:30.619177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:30.646316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:30.655006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 316/632] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:30.660462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.671135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e4416-e3cc-4382-9bbd-85d081922db9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.675092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.675790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.676078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.676360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.688687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:30.714071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:30.731935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:30.732975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 317/633] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:30.738389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.747991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9484c1c-2183-4a5e-b4b8-7c5433cfe051 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.752009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.752534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.752822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.753105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.753787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:30.754120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:30.779202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:30.791542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 317/634] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:30.797229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.806210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57612-c964-4703-b556-551d35c7473c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.810901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.811611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.811894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.812170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.825369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:30.854268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:30.873566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:30.874664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 318/635] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:30.880318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.889695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19393165-e17f-4a0d-a525-e4b04e39b0a9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.893685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.894310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.894601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.894887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.895678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:30.895984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:30.921755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:30.950838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 318/636] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:30.956235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:30.965361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05526-8e55-458b-aae7-63d7622a16fb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:30.969290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:30.970022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:30.970312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:30.970593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:30.983345 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:31.008806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:31.025395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:31.027018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 319/637] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:31.032451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:31.041631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a31bea-7b41-4086-a7bc-ff5505f30131 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:31.046334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:31.046915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:31.047209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:31.047495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:31.048184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:31.048484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:31.074021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:31.085700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 319/638] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:31.091386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:31.100371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de574-b966-49ca-973d-3f3ab12670c3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:31.104892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:31.105818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:31.106141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:31.106423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:31.115202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:31.140281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:31.154001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:31.155024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 320/639] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:31.160267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:31.169381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffab81b-4dc4-42b3-91c2-00a5b56b87f4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:31.173356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:31.173949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:31.174250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:31.174534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:31.175271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:31.175574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:31.202164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636e98-51ed-4e4f-b4f0-a4422a85ecdb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:31.214820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 320/640] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:31.220144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:31.229040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8488f7-4050-4eb4-832c-bf16cb73fb37 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:31.233001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:31.233785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:31.234113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:31.234397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/b0f2d90de9d44b48a4d92f9380861ceb/roles/e5ec215ce8024dde8601defe84e3cdaf` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:31.236374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=b0f2d90de9d44b48a4d92f9380861ceb, role_id=e5ec215ce8024dde8601defe84e3cdaf)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:31.263081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd492-2e1f-4f30-84a9-fbeafde25222 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:31.411865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 321/641] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:51:31 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/b0f2d90de9d44b48a4d92f9380861ceb/roles/e5ec215ce8024dde8601defe84e3cdaf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:51:33.376045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bb59-19d4-44f2-a6ea-f14c83f5ad9c None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.376594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bb59-19d4-44f2-a6ea-f14c83f5ad9c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.376594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bb59-19d4-44f2-a6ea-f14c83f5ad9c None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.378297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 321/642] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:33.383254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.383682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.383814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.408552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:33.409676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:33.472236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 322/643] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:33 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:33.494588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4bb59-19d4-44f2-a6ea-f14c83f5ad9c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.506577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4bb59-19d4-44f2-a6ea-f14c83f5ad9c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.510478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.511796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.512078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.512444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.523255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:33.530127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 09:51:33.531200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 322/644] 10.222.0.11 () {56 vars in 1141 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:33.536668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.544946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6009-8952-4b51-ac8d-ad9154623c04 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.548844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.549423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.549708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.550019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.550725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:33.551021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.576871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.584906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 323/645] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:33.590531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.599928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827dfc-c1b2-4dcc-9b74-0d31c60b877b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.603939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.604647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.604917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.605196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.616077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.642441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.659549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:33.660589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 323/646] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:33.665803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.675600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bc69d-eb57-4836-b8b7-cea0e88d231f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.679513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.680076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.680359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.680632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.681303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:33.681596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.707025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.719539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 324/647] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:33.724623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.734239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3275-972d-4405-8623-264f15667cbe admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.738204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.738912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.739200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.739480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.751881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.778282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.795651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 09:51:33.796682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 324/648] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:33.801982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.811118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172335aa-26c0-44d7-9796-0442858a48f5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.815157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.815737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.816024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.816304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.817088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:33.817387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.843977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.871838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 325/649] 10.222.0.11 () {56 vars in 1170 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:33.877209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.886844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e293ee-bb47-4d9a-a7a6-896467adb930 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.890863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.891451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.891740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.892023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.899556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.925385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:33.933826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 325/650] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:33.939001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:33.948731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bacd4-0322-4fff-bf51-d02cf14c43eb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:33.952666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:33.953374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:33.953659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:33.953955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:33.966065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:33.991107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:34.012471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:34.013600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 326/651] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:34.019196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:34.037635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d6db-d9f6-440c-a4f9-100ca268420a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:34.050946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:34.051518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:34.051802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:34.052084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:34.052765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:34.053061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:34.079882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:34.092902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 326/652] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:34.098315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:34.107449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238047c-c606-4012-b249-26402ee24eb1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:34.111383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:34.112083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:34.112367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:34.112645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:34.122032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:34.147508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:34.160816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:34.161792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 327/653] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:34.167585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:34.177267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476891-af5c-45dc-a002-abae9ba19791 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:34.181186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:34.181756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:34.182080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:34.183359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:34.184105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:34.184404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:34.210762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764930-d118-4ad3-b686-c2678ab581c1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:34.224787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 327/654] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:34.230763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:34.239810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917ae7-46bd-42de-9c09-c5ab8776cb5a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:34.243783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:34.244347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:34.244632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:34.245522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:34.246321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] RBAC: Adding query filter params (role.id=e5ec215ce8024dde8601defe84e3cdaf, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=b0f2d90de9d44b48a4d92f9380861ceb) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:34.246625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:34.272076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891724-cb02-4da9-9cfe-4d01c263efb3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:34.278035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 328/655] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:34 2022] GET /identity/v3/role_assignments?user.id=b0f2d90de9d44b48a4d92f9380861ceb&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=e5ec215ce8024dde8601defe84e3cdaf => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:36.289379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5ab0-172d-4e7f-b894-0b3a6d8d8b80 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:36.289878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5ab0-172d-4e7f-b894-0b3a6d8d8b80 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:36.289984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5ab0-172d-4e7f-b894-0b3a6d8d8b80 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:36.292065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 328/656] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:36.296601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:36.297001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:36.297172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:36.319957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:36.321076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:36.328576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 329/657] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:36 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:51:36.353647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a5ab0-172d-4e7f-b894-0b3a6d8d8b80 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:36.365311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a5ab0-172d-4e7f-b894-0b3a6d8d8b80 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:36.369174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:36.370445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:36.370445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:36.370986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:36.371604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:36.397032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:36.407233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 09:51:36.408293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 329/658] 10.222.0.11 () {56 vars in 1126 bytes} [Wed Apr 6 09:51:36 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:36.414019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:36.422534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7b9e-55da-4125-911f-37cb47966c24 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:36.426499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:36.427077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:36.427364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:36.427644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:36.428312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:36.428611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:36.454898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e6500-fe12-4f4d-8d0d-3e7b7b4e2898 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:36.459190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 330/659] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:36.464491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:36.473455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d15d-39ff-4f5d-91c2-45b25979e611 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:36.477446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:36.478046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:36.478339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:36.478623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:36.479333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] RBAC: Adding query filter params (type=image) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:36.479633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:36.504800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2eddb-e370-48ad-af9c-e50a607bbecf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:36.508944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 330/660] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:38.483580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddaf1-295c-48aa-96a2-46ec08176e29 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:38.484098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddaf1-295c-48aa-96a2-46ec08176e29 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:38.484224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddaf1-295c-48aa-96a2-46ec08176e29 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:38.485808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 331/661] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:38.490921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fd7-32f8-4267-8671-ea374df07676 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:38.491314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fd7-32f8-4267-8671-ea374df07676 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:38.491491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fd7-32f8-4267-8671-ea374df07676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:38.513951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1b922fd7-32f8-4267-8671-ea374df07676 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:38.515078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1b922fd7-32f8-4267-8671-ea374df07676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:38.521669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 331/662] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:38 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:38.544036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ddaf1-295c-48aa-96a2-46ec08176e29 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:38.555334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ddaf1-295c-48aa-96a2-46ec08176e29 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:38.559514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:38.560083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:38.560368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:38.560644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:38.561317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:38.586407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5574-443d-4a05-9913-509677c0cc73 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:38.680732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 332/663] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:51:38 2022] POST /identity/v3/services => generated 242 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:51:40.684060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3514-776e-47e5-ab8a-48cbfbc7707d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.684589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3514-776e-47e5-ab8a-48cbfbc7707d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.684706 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc3514-776e-47e5-ab8a-48cbfbc7707d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.686301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 332/664] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:40.691409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.691815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.691976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.714052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:40.715161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:40.732068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 333/665] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:40 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:40.754294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc3514-776e-47e5-ab8a-48cbfbc7707d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:40.765839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc3514-776e-47e5-ab8a-48cbfbc7707d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:40.769678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:40.770436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.770725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.771004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.771624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:40.797443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:40.807355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 09:51:40.808410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 333/666] 10.222.0.11 () {56 vars in 1126 bytes} [Wed Apr 6 09:51:40 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:40.813859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:40.822508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6da3-1d03-4c44-8e38-d45f61f214d4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:40.826643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:40.827220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.827506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.827787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.828459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:40.828760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:40.854938 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:40.859380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 334/667] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:40.864681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:40.873982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3be1-3be2-4faf-96c2-dc6e209d6532 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:40.878014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:40.878592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.878878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.879157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.879824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:40.880119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:40.906048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:40.910813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 334/668] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:40.917059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:40.926306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccdee3-e89a-4010-931d-b8a5430fb514 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:40.930256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:40.930828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.931113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.931390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.932317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] RBAC: Adding query filter params (interface=public, service_id=0245dc6493b145398d57861cac87a757, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:40.932622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:40.957624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52306c95-617e-49e6-beaa-4d4cd6812b5e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:40.962747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 335/669] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:51:40 2022] GET /identity/v3/endpoints?service_id=0245dc6493b145398d57861cac87a757&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:40.968562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:40.977607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825be8-bb11-44e7-8e64-3edb469600b4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:40.982355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:40.982935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:40.983224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:40.983504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:40.984151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:41.008784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d6957-8538-4792-975c-41610618ccd2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:41.014154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 335/670] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:51:40 2022] GET /identity/v3/services => generated 1022 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 09:51:42.965514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002111-1aed-43c2-9aa0-70825762466b None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:42.966051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002111-1aed-43c2-9aa0-70825762466b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:42.966135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38002111-1aed-43c2-9aa0-70825762466b None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:42.967769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 336/671] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:42.972764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:42.973178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:42.973334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:42.995380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:42.996501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:43.003090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 336/672] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:42 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:43.024739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38002111-1aed-43c2-9aa0-70825762466b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:43.036837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38002111-1aed-43c2-9aa0-70825762466b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:43.040664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:43.041551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:43.041945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:43.042240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:43.042864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:43.068368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:43.078914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 09:51:43.079947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 337/673] 10.222.0.11 () {56 vars in 1126 bytes} [Wed Apr 6 09:51:43 2022] GET /identity/v3/services/image => generated 86 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:43.085482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:43.093875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14727b66-6998-4eb7-ab4a-4c8ff92dae6b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:43.097793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:43.098406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:43.098693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:43.098968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:43.099630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] RBAC: Adding query filter params (name=image) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:43.099922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:43.125214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:43.129522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 337/674] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:43.134721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:43.144207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1702-0860-4b97-9b4b-26f7ce1cf5f5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:43.148151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:43.148719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:43.149005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:43.149282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:43.149960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:43.150267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:43.174898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416750a-2618-425c-b02b-bd5fd150c0d5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:43.179397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 338/675] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:43.184968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:43.194004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e738-5f66-418d-9ced-80db0a1e663d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:43.198454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:43.199007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:43.199293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:43.199573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:43.200249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:43.224610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f2926-65b1-424c-9439-cd9681faf453 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:43.290994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 338/676] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:51:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:51:45.252330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891b90-1073-4098-bebe-d8f8e329a76b None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:45.252818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891b90-1073-4098-bebe-d8f8e329a76b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:45.252818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd891b90-1073-4098-bebe-d8f8e329a76b None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:45.254515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 339/677] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:45.259429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:45.260361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:45.261862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:45.283427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:45.284556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:45.300418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 339/678] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:45 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:45.325565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd891b90-1073-4098-bebe-d8f8e329a76b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:45.339439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd891b90-1073-4098-bebe-d8f8e329a76b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:45.343262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:45.343826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:45.344114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:45.344394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:45.351796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:45.377263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402a81-e554-4755-85d0-c8bf5a965cc3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:45.387038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 340/679] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:45 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:45.392687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:45.401754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726bba7-e3ea-427e-a555-919f34706708 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:45.405757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:45.406571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:45.406862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:45.407145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:45.408206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:45.433734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b7d31-4351-4455-b3bf-97be8abc3f40 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:45.435175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 340/680] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:47.492977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5679f-32bb-46e2-a46c-dc9d469d2bb4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:47.493498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5679f-32bb-46e2-a46c-dc9d469d2bb4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:47.493722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5679f-32bb-46e2-a46c-dc9d469d2bb4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:47.495409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 341/681] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:47.501051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:47.501446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:47.501619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:47.523454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:47.524569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:47.531735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 341/682] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:47 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:47.554933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5679f-32bb-46e2-a46c-dc9d469d2bb4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:47.567373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5679f-32bb-46e2-a46c-dc9d469d2bb4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:47.571201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:47.571894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:47.572718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:47.573461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:47.584654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:47.610159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:47.627413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:47.628466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 342/683] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:47.634214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:47.643446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb6094-eef2-489c-9799-465a506399b4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:47.647410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:47.647989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:47.648276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:47.648555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:47.649257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:47.649550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:47.674334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cbce8-adc5-4ac1-bfa5-36628a7c6f3d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:47.687133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 342/684] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:47.692644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:47.702652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23a9c-c7a0-4b37-b942-2de6389a9c4d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:47.706551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:47.707117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:47.707396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:47.707669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:47.708300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:47.733954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b64d8-69dc-4308-9ddb-7bac8885efc8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:47.805287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 343/685] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:51:47 2022] POST /identity/v3/users => generated 248 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:51:49.806574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0558f0-0393-4b08-b53b-bd99bd159a43 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:49.807212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0558f0-0393-4b08-b53b-bd99bd159a43 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:49.807212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0558f0-0393-4b08-b53b-bd99bd159a43 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:49.808821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 343/686] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:49.814356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:49.814760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:49.814926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:49.836867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:49.839080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:49.845651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 344/687] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:49 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:49.867209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0558f0-0393-4b08-b53b-bd99bd159a43 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:49.879487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0558f0-0393-4b08-b53b-bd99bd159a43 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:49.883332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:49.884035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:49.884322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:49.885465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:49.896320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:49.903037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:49.904102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 344/688] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:49.909580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:49.918103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1454f-d371-40ef-9c20-f2d7d4e514c2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:49.922161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:49.922747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:49.923033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:49.923313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:49.924018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:49.924317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:49.950363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:49.958728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 345/689] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:49.964203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:49.975143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd0c89-fed4-442f-b5fc-462389d9559d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:49.979333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:49.980042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:49.980336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:49.980623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:49.991715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.018160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.035534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:50.036624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 345/690] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:50.042515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.051654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d8ab9-b990-450a-a2d1-4fc8d73f71c8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.055677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.056253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.057199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.057427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.058169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:50.058468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.084167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.096507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 346/691] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:50.101743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.111164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55060-9502-4116-809c-95aefd26eeb7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.115210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.115912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.116200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.116481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.129219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.155210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.172948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 09:51:50.174023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 346/692] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:50.179716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.189087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6eb3a-6483-42fe-88c9-fa815ff3c2bd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.193289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.193868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.194187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.194466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.195243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:50.195540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.221557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.249636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 347/693] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:50.254956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.264886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b635d-1c57-4481-bb3d-ea57579cd4ab admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.269114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.269673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.269979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.270260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.278339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.303291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.311535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 347/694] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:50.317208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.326891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee341b-80d6-4d45-8720-7b9b98e952f6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.330937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.331642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.331934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.332217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.344305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.369468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.386364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:50.387401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 348/695] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:50.392560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.401370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e2580-f710-49e3-839d-1abaacc199f1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.405299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.405869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.406412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.406736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.407416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:50.407715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.432576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.445501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 348/696] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:50.451293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.460322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516d21-77cf-4767-b48a-f63c15c11fec admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.464908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.465603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.465892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.466206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.474940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.501219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.514520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:50.515592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 349/697] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:51:50.521007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.530464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c66d14-339f-4c99-a5ba-a52ae4c25a3b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.534382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.534949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.535233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.535537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.536269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:50.536567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.562434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7cbcb-5c03-4456-9f93-297db3870fe6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.575358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 349/698] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:50.580828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:50.590399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f99fbf-6b12-490a-b552-8bf2ccee7306 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:50.594339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:50.594903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:50.595192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:50.595472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:50.596242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=125ce3f900a94e639c62b77d4f7d9c81) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:50.596542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:50.622212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911cb03-f294-4c78-a26a-26408e1d28ff admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:50.627309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 350/699] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:50 2022] GET /identity/v3/role_assignments?user.id=125ce3f900a94e639c62b77d4f7d9c81&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:52.577833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954a3a-5095-4911-8897-d82cb5887c40 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.578391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954a3a-5095-4911-8897-d82cb5887c40 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.578479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b954a3a-5095-4911-8897-d82cb5887c40 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.580106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 350/700] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:52.585249 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.585671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.585814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.608455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:52.609572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:52.616186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 351/701] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:52 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:52.638322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954a3a-5095-4911-8897-d82cb5887c40 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.649707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b954a3a-5095-4911-8897-d82cb5887c40 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.653845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.654584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.654879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.655164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.666675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:52.672918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:52.673998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 351/702] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:52.679489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.688240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8927433-0e5c-42a1-b4b1-18584a7b3616 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.692978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.693342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.693628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.693906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.694648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:52.694945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:52.720996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:52.729620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 352/703] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:52.735252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.745305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199be6-f8c0-45c5-a5ff-0ea5abcfd900 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.749444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.750185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.750473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.750755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.762297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:52.788113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:52.806107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:52.807715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 352/704] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:52.813180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.823199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fc5a8-408a-4b25-b1e0-72e66e3eed46 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.827178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.827750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.828085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.828315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.828995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:52.829294 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:52.854158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:52.866507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 353/705] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:52.872347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.881302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd067395-f966-4a36-8783-dd9448c1ac79 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.886139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.886836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.887118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.887395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.900022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:52.926093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:52.944307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 09:51:52.945377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 353/706] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:52.951646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:52.960960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5cf77-42a1-47ef-a865-a48187a958e7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:52.965209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:52.965864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:52.966246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:52.966615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:52.967464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:52.967834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:52.997650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.026794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 354/707] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:53.032478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:53.041765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c081fc-57f9-4dca-b15a-7d1b9650786e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:53.045790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:53.046539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:53.046828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:53.047108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:53.059653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:53.085553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.101723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:53.102803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 354/708] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:53.108466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:53.117486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb8232-9335-4810-af98-fff7e824aaa6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:53.122026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:53.122604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:53.122892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:53.123172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:53.123851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:53.124150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:53.148762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.160445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 355/709] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:53.166235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:53.175307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33b4c5-7da7-4052-bc05-e4fe1532037b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:53.179288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:53.179979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:53.180267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:53.180549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:53.189944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:53.215333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.229270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:53.230342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 355/710] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:53.235577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:53.244880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc21347-688c-4e8d-9ea0-8c9e0744e20c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:53.248895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:53.249460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:53.249745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:53.250060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:53.250795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:53.251094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:53.277421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bda474-36a2-46eb-a81d-8c678d2bd95d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.297236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 356/711] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:53.303072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:53.312565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1d25-d962-4b6f-999f-a7222c2113c1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:53.316645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:53.317714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:53.318034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:53.318319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/125ce3f900a94e639c62b77d4f7d9c81/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:53.339017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=125ce3f900a94e639c62b77d4f7d9c81, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:53.365770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797a31-6158-4198-ba8f-0cfa2bbfba2c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:53.508195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 356/712] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:51:53 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/125ce3f900a94e639c62b77d4f7d9c81/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:51:55.466178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c271-bbf1-4ce2-8d67-3c98cc9f7d7d None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.466723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c271-bbf1-4ce2-8d67-3c98cc9f7d7d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.466723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c271-bbf1-4ce2-8d67-3c98cc9f7d7d None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.468416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 357/713] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:55.473340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.473742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.473910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.496733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:55.497856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:55.559456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 357/714] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:55 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:55.581772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8c271-bbf1-4ce2-8d67-3c98cc9f7d7d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.593315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8c271-bbf1-4ce2-8d67-3c98cc9f7d7d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.597152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281372-0add-4628-b991-497e44a385bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.597854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281372-0add-4628-b991-497e44a385bf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.598168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281372-0add-4628-b991-497e44a385bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.598446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13281372-0add-4628-b991-497e44a385bf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.609906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13281372-0add-4628-b991-497e44a385bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:51:55.616149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-13281372-0add-4628-b991-497e44a385bf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:51:55.617229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 358/715] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:55.622622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.630959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de08bb2-6c73-41fd-9e3f-84a2c2d9f9cc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.635563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.636147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.636435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.636717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.637428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:55.637730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:55.663347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:55.671460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 358/716] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:55.676827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281372-0add-4628-b991-497e44a385bf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.688269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13281372-0add-4628-b991-497e44a385bf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.692518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.693210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.693495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.693775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.705285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:55.730853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:55.747924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:55.748954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 359/717] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:55.754228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.763738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151499-6399-4e7c-8814-7e595655b56b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.767737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.768304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.768588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.768868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.769544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:55.769840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:55.795427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:55.808358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 359/718] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:55.813592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.823020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4bc4-6e30-4144-bef6-0b0f8fb1534b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.826995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.827716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.828003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.828279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.841030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:55.866633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:55.883895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 09:51:55.885099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 360/719] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:55.890497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.899409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43853e7-b48e-4a66-838a-5daafe7a592b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.904345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.904923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.905206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.905485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.906300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:55.906599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:55.932680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:55.960857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 360/720] 10.222.0.11 () {56 vars in 1158 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:55.966939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:55.975950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce031f2-1d5f-40c8-bf33-e07d98c84e30 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:55.980496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:55.981105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:55.981343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:55.981619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:55.989029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.014228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.022414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 361/721] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:51:55 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:51:56.028695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:56.037670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65813b1-fdc3-4086-8839-72836ee014a2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:56.042271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:56.042975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:56.043264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:56.043542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:56.054618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.079938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.096986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:51:56.098048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 361/722] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:56.103893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:56.112164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef93b8-ce78-47e9-9e78-00e3f8ef1194 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:56.116187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:56.116761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:56.117048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:56.117330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:56.118046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:56.118348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.143466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.156681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 362/723] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:56.161744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:56.170752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5520a8-43f6-426f-8a39-8d9ecab55810 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:56.174652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:56.175701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:56.175984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:56.176260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:56.186674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.213284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.226372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:51:56.227681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 362/724] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:56.233389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:56.242433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add005c6-744e-4ccf-ba59-090c0f1d868a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:56.246540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:56.247111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:56.247397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:56.247678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:56.248440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:56.248744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.274059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f9c6-5b97-496d-a42f-a30e0c54a506 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.287388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 363/725] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:56.292722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:56.301532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378ce2-4aee-4816-9791-0022c8297d2a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:56.305420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:56.306006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:56.306406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:56.306678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:56.307438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=125ce3f900a94e639c62b77d4f7d9c81) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:56.307737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:56.333751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9a91-ef98-4ada-8bc4-9e82fee02924 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:56.340324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 363/726] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:51:56 2022] GET /identity/v3/role_assignments?user.id=125ce3f900a94e639c62b77d4f7d9c81&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:51:58.331085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23964f-ea29-40e7-9a82-8b806d22aaa4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:58.331624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23964f-ea29-40e7-9a82-8b806d22aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:58.331624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23964f-ea29-40e7-9a82-8b806d22aaa4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:58.333296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 364/727] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:51:58.338800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:58.339214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:58.339396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:58.361737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:51:58.362891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:51:58.370072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 364/728] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:51:58 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:51:58.391871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23964f-ea29-40e7-9a82-8b806d22aaa4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:58.403372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23964f-ea29-40e7-9a82-8b806d22aaa4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:58.407178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:58.407890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:58.408174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:58.408451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:58.409071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:58.434938 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:58.445687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 09:51:58.446799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 365/729] 10.222.0.11 () {56 vars in 1150 bytes} [Wed Apr 6 09:51:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:51:58.452664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:58.460955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f0033-b550-440a-be8f-d9aeefe15d10 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:58.465106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:58.465674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:58.465987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:58.466267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:58.466935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:58.467229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:58.492256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648a9d7-d655-443e-b25d-fcae02cfea22 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:58.497276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 365/730] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:51:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:51:58.502669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:51:58.511614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce3ab5-85ad-4d6d-8dd9-591cb53176c6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:51:58.515619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:51:58.516192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:51:58.516480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:51:58.516763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:51:58.517425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:51:58.517723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:51:58.542726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a808fc3-ad45-4ece-a16b-a6797acbbe95 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:51:58.546885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 366/731] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:51:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:00.515376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5fa1-cb4f-4056-a5cb-034eaa7c0b0e None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:00.515895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5fa1-cb4f-4056-a5cb-034eaa7c0b0e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:00.515979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5fa1-cb4f-4056-a5cb-034eaa7c0b0e None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:00.517602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 366/732] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:00.522592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498a79-fd68-4c3a-b4a0-a30d23d5e6a0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:00.523002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498a79-fd68-4c3a-b4a0-a30d23d5e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:00.523157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be498a79-fd68-4c3a-b4a0-a30d23d5e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:00.546069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-be498a79-fd68-4c3a-b4a0-a30d23d5e6a0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:00.547177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-be498a79-fd68-4c3a-b4a0-a30d23d5e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:00.553724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 367/733] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:00 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:00.575793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5fa1-cb4f-4056-a5cb-034eaa7c0b0e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:00.588066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca5fa1-cb4f-4056-a5cb-034eaa7c0b0e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:00.591980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:00.592558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:00.592849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:00.593134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:00.593811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:00.619322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc80a0-8a1a-4d13-a858-241cc694961d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:00.717922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 367/734] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:52:00 2022] POST /identity/v3/services => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:02.713415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc3fc-5f8d-428d-9aac-0d0ef1b30e0d None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.713957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc3fc-5f8d-428d-9aac-0d0ef1b30e0d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.714070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc3fc-5f8d-428d-9aac-0d0ef1b30e0d None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.715705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 368/735] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:02.721300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.721690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.721869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.744458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:02.746313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:02.764289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 368/736] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:02 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:52:02.786464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bc3fc-5f8d-428d-9aac-0d0ef1b30e0d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:02.798569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bc3fc-5f8d-428d-9aac-0d0ef1b30e0d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:02.802685 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:02.803403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.803687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.803962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.804575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:02.830041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:02.841147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 09:52:02.842222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 369/737] 10.222.0.11 () {56 vars in 1150 bytes} [Wed Apr 6 09:52:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:02.847829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:02.856876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82f71c-b6fe-42e9-acd8-c82c2e726bdd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:02.860877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:02.861457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.861744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.862052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.862728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:02.863028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:02.888467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:02.892844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 369/738] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:52:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:02.898034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:02.907274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aded1-dfb4-49d1-a031-b3ae1710ebcd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:02.911204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:02.911768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.912052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.912329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.912989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:02.913286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:02.940271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:02.945678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 370/739] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:52:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:02.951267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:02.960530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386865-c549-46ca-8bfe-2b92411419d7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:02.965181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:02.965695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:02.966007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:02.966293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:02.967034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] RBAC: Adding query filter params (interface=public, service_id=63e45033da7240b8b07afc3165c20b8f, region_id=RegionOne) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:02.967334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:02.992897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bb343-074b-42fe-bc58-c25c4f18eeba admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:02.999178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 370/740] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:52:02 2022] GET /identity/v3/endpoints?service_id=63e45033da7240b8b07afc3165c20b8f&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:03.004443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:03.013845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d76c5-468d-4dba-96da-d6e1f921b088 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:03.017794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:03.018402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:03.018691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:03.018971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:03.019616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:03.045167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1109e8-d6cd-48f8-9926-8e3c3ae433cb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:03.050630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 371/741] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:52:03 2022] GET /identity/v3/services => generated 1261 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 09:52:05.000624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818bf-4dd7-4ebe-8bf1-9e464e07c2a5 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.001078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818bf-4dd7-4ebe-8bf1-9e464e07c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.001177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c818bf-4dd7-4ebe-8bf1-9e464e07c2a5 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.002882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 371/742] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:05.008153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.008569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.008783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.031330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:05.032433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:05.038986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 372/743] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:05 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:52:05.061340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c818bf-4dd7-4ebe-8bf1-9e464e07c2a5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:05.073106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c818bf-4dd7-4ebe-8bf1-9e464e07c2a5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:05.076970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:05.077685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.077999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.078283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.078907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:05.105012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:05.116357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 09:52:05.117478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 372/744] 10.222.0.11 () {56 vars in 1150 bytes} [Wed Apr 6 09:52:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:05.123422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:05.131924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d8c1-24b1-4644-b2c5-e0ae9e1c2db3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:05.136426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:05.136996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.137277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.137550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.138251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:05.138545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:05.163630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:05.168060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 373/745] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:52:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:05.173447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:05.182627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db42a96-a10f-4977-b15c-234d310475c4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:05.186637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:05.187213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.187503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.187784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.188447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:05.188745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:05.214958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ecd21-2b85-40df-86c5-b456dd69d932 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:05.219473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 373/746] 10.222.0.11 () {56 vars in 1145 bytes} [Wed Apr 6 09:52:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:05.224540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:05.233660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f1a-1c21-43f7-ab29-a8c910987490 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:05.237574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:05.238172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:05.238461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:05.238739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:05.239422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:05.264475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e090-884e-44d5-a304-568b82a71113 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:05.375881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 374/747] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:52:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:07.357471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8d35-8c62-4c2a-887c-b542514e8a84 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:07.358098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8d35-8c62-4c2a-887c-b542514e8a84 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:07.358098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8d35-8c62-4c2a-887c-b542514e8a84 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:07.359770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 374/748] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:07.364740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:07.365143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:07.365310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:07.388805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:07.389968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:07.407289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 375/749] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:07 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:07.428941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8d35-8c62-4c2a-887c-b542514e8a84 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:07.441573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8d35-8c62-4c2a-887c-b542514e8a84 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:07.445408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:07.446137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:07.446814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:07.447099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:07.447715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:07.472759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:07.483854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 06 09:52:07.484888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 375/750] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:07 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:07.490408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:07.499349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50008c13-2814-4bf0-a47d-d504813998f2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:07.503318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:07.503896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:07.504183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:07.504461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:07.505132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:07.505431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:07.530169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967060e-d58c-4caf-918c-305f4815447f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:07.534603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 376/751] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:07 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:07.539708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:07.550491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7df709-b08b-47a8-bba0-9944c8cfe926 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:07.554422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:07.554988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:07.555271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:07.556649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:07.557317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:07.557616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:07.582821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985dc10-70ed-4d90-adc0-13e92be659a9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:07.587463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 376/752] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:07 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:09.563788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4cf5e-d271-4b05-9133-bb891b64bccd None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:09.564313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4cf5e-d271-4b05-9133-bb891b64bccd None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:09.564426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4cf5e-d271-4b05-9133-bb891b64bccd None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:09.566043 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 377/753] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:09.572426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8760-2ca0-4751-9eef-de43e0daf707 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:09.572862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8760-2ca0-4751-9eef-de43e0daf707 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:09.572988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8760-2ca0-4751-9eef-de43e0daf707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:09.595029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0a8b8760-2ca0-4751-9eef-de43e0daf707 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:09.596140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0a8b8760-2ca0-4751-9eef-de43e0daf707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:09.603298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 377/754] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:09 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:09.625269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4cf5e-d271-4b05-9133-bb891b64bccd None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:09.637120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4cf5e-d271-4b05-9133-bb891b64bccd None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:09.640948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:09.641520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:09.641809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:09.642119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:09.642783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:09.667911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50264ae2-8476-4ffd-aa39-0c88461d420b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:09.769340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 378/755] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:52:09 2022] POST /identity/v3/services => generated 251 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:11.738404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f77e8-3087-4f4f-8de7-051611f76103 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.738942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f77e8-3087-4f4f-8de7-051611f76103 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.739040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f77e8-3087-4f4f-8de7-051611f76103 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.740621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 378/756] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:11.746457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.746857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.747014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.769385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:11.770518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:11.786211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 379/757] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:11 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:52:11.809005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f77e8-3087-4f4f-8de7-051611f76103 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:11.820684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f77e8-3087-4f4f-8de7-051611f76103 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:11.825509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:11.826257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.826551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.826836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.827464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:11.852592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:11.862832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 06 09:52:11.863883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 379/758] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:11 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:11.870182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:11.878488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782f5c8-4ea8-413f-a3c5-391755dd8680 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:11.882416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:11.882987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.883269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.884126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.884929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:11.885223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:11.910183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:11.914652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 380/759] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:11 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:11.920456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:11.929625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee38d2-d98b-4034-afc3-9d01c4e26c37 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:11.934264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:11.934832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.935122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.935400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.936066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:11.936364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:11.961646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:11.966852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 380/760] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:11 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:11.972414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:11.981954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404d25d-d680-44b4-879e-17a4651b681a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:11.985881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:11.986502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:11.986788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:11.987067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:11.987803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] RBAC: Adding query filter params (interface=public, service_id=dd72a2ced12345afb85b874cbeb48563, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:11.988104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:12.013821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff7537-52ec-4171-9eaf-b51c50b0f289 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:12.018837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 381/761] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:52:11 2022] GET /identity/v3/endpoints?service_id=dd72a2ced12345afb85b874cbeb48563&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:12.024010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:12.033274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bafcac-7bb8-47b1-a573-12b8cada15b5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:12.037202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:12.037774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:12.038097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:12.038373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:12.039009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:12.064884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9336101-48a8-41ac-8fc2-11f7a6a013eb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:12.070849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 381/762] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:52:12 2022] GET /identity/v3/services => generated 1500 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 09:52:14.035613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361436-5797-4f76-9e34-7bcb058bca2e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.036130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361436-5797-4f76-9e34-7bcb058bca2e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.036228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361436-5797-4f76-9e34-7bcb058bca2e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.037852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 382/763] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:14.043642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.044034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.044210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.065924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:14.067319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:14.074101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 382/764] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:14 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:14.096049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361436-5797-4f76-9e34-7bcb058bca2e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:14.108178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361436-5797-4f76-9e34-7bcb058bca2e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:14.112099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:14.112808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.113095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.113377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.114033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:14.139409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:14.150362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 06 09:52:14.151398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 383/765] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:14 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:14.156786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:14.165064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c412f0-d51b-4556-bf5e-e86c1f1d2fe5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:14.169248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:14.169836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.170153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.170433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.171109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:14.171410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:14.197096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:14.201682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 383/766] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:14 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:14.206948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:14.216532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306a70-b387-42d0-91de-406a2ecffc5a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:14.220550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:14.221119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.221411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.221694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.222400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:14.222701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:14.247661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df99b8-ef1d-48a0-b384-1975ab9a8e46 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:14.252171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 384/767] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:14 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:14.257491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:14.266997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1211fc-4210-42d6-8943-626f07005fe6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:14.270973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:14.271534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:14.271823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:14.272101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:14.272774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:14.298497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d193a0-031d-4511-99cc-31af01156cf3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:14.437524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 384/768] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:52:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:16.459652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5425c-07e1-484b-9bd3-a8ef187c934c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:16.460171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5425c-07e1-484b-9bd3-a8ef187c934c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:16.460281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5425c-07e1-484b-9bd3-a8ef187c934c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:16.461998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 385/769] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:16.467275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:16.467667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:16.467854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:16.490215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:16.491348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:16.508181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 385/770] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:16 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:16.530326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5425c-07e1-484b-9bd3-a8ef187c934c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:16.542382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5425c-07e1-484b-9bd3-a8ef187c934c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:16.546339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:16.547048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:16.547350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:16.547620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:16.548240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:16.573786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:16.584132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 09:52:16.585168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 386/771] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:16.591372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:16.599825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3747ca5-2bfd-43d2-ab7a-ccca886a7224 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:16.604608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:16.605193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:16.605483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:16.605766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:16.606477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:16.606782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:16.631881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fc122-6532-41af-98e2-54b641b99b75 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:16.637208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 386/772] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:16.642783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:16.652981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83f13b-460f-41c3-8da0-ac1549015ac4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:16.657076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:16.657652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:16.657952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:16.658258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:16.658926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:16.659229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:16.684974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a0b21-5a67-441a-a9c4-feec9d13b9e6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:16.689185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 387/773] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:18.650346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d33f-dbc8-4b6e-945e-587a21c388a0 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:18.650876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d33f-dbc8-4b6e-945e-587a21c388a0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:18.650963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d33f-dbc8-4b6e-945e-587a21c388a0 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:18.652574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 387/774] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:18.657888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8661b-fd38-4dcd-85df-39c126428404 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:18.658289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8661b-fd38-4dcd-85df-39c126428404 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:18.658477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8661b-fd38-4dcd-85df-39c126428404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:18.681465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-78c8661b-fd38-4dcd-85df-39c126428404 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:18.682609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-78c8661b-fd38-4dcd-85df-39c126428404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:18.689223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 388/775] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:18 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:18.710933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d33f-dbc8-4b6e-945e-587a21c388a0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:18.722893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d33f-dbc8-4b6e-945e-587a21c388a0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:18.726809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:18.727960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:18.728250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:18.728543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:18.729223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:18.754974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b781fcd-700f-4f28-8b2b-5c509e0a8ed3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:18.838875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 388/776] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:52:18 2022] POST /identity/v3/services => generated 251 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:20.841897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b65168-8e11-4602-8039-d1156ec6f89c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:20.842439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b65168-8e11-4602-8039-d1156ec6f89c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:20.842523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b65168-8e11-4602-8039-d1156ec6f89c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:20.844153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 389/777] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:20.849147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:20.849527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:20.849720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:20.873326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:20.874462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:20.891947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 389/778] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:20 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:20.914021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b65168-8e11-4602-8039-d1156ec6f89c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:20.925389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b65168-8e11-4602-8039-d1156ec6f89c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:20.929190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:20.929886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:20.930212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:20.930559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:20.931182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:20.956531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:20.968363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 09:52:20.969416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 390/779] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:20.975134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:20.984687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdafb4-cc5c-4094-a015-f1936cd2dbd4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:20.989029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:20.989616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:20.989902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:20.990216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:20.990893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:20.991189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:21.017215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:21.022122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 390/780] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:21.028442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:21.037615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8151-1173-4e22-b5e9-8f6b8c7378a1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:21.041965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:21.042554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:21.042844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:21.043125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:21.043800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:21.044100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:21.068879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:21.073924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 391/781] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:21.079476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:21.089092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee3f8e-a930-423e-b487-ecee951223c4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:21.093167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:21.093686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:21.094008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:21.094294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:21.095038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] RBAC: Adding query filter params (interface=public, service_id=2a31d09770304d05869c3f36349ef49c, region_id=RegionOne) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:21.095343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:21.120291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a8b4-9cc5-4f0a-8aa2-c2610161cfe8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:21.125335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 391/782] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:52:21 2022] GET /identity/v3/endpoints?service_id=2a31d09770304d05869c3f36349ef49c&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:52:21.130593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:21.140105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543977a1-0e8b-4c2c-9a18-5600ba337224 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:21.144177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:21.144752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:21.145040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:21.145322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:21.145995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:21.171046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c7390-011d-42d8-bc30-cc767e09ee73 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:21.177063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 392/783] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:52:21 2022] GET /identity/v3/services => generated 1739 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 09:52:23.147036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097c968-88dd-43aa-9d3e-bda990c80c7b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.147544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097c968-88dd-43aa-9d3e-bda990c80c7b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.147629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097c968-88dd-43aa-9d3e-bda990c80c7b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.149867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 392/784] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:23.154977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.155416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.155552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.177315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:23.178456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:23.185272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 393/785] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:23 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:23.207575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097c968-88dd-43aa-9d3e-bda990c80c7b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:23.219570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097c968-88dd-43aa-9d3e-bda990c80c7b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:23.223442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:23.224146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.224434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.224713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.225329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:23.250357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:23.261035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 09:52:23.262094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 393/786] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:23.267824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:23.276457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf29d4-487a-4f81-ae8a-488939717e88 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:23.280527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:23.281104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.281390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.281673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.282384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:23.282683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:23.308398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:23.312998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 394/787] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:23.318489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:23.327913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dcfca-9b80-4794-aa94-d4a7463fd609 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:23.331893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:23.332460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.332745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.333023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.333680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:23.334001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:23.361177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0bcd3-971a-4381-9159-2260219a7838 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:23.365701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 394/788] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:52:23.371549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:23.380444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a34d-cc7f-4285-8a39-3c8e4d9527d8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:23.384905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:23.385460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:23.385747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:23.386057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:23.386743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:23.411022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ae47a-94d8-488a-bf8a-8bc7c8d3d59d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:23.513075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 395/789] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:52:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:52:25.501109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3012-9d49-4dda-a20a-52f36dc5a83e None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:25.501688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3012-9d49-4dda-a20a-52f36dc5a83e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:25.501688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3012-9d49-4dda-a20a-52f36dc5a83e None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:25.503422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 395/790] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:25.509121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:25.509548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:25.509685 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:25.533292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:25.534461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:25.550774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 396/791] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:25 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:25.573650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3012-9d49-4dda-a20a-52f36dc5a83e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:25.584950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3012-9d49-4dda-a20a-52f36dc5a83e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:25.589585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:25.590182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:25.590467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:25.590745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:25.591385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:25.616519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:25.617978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.common [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 06 09:52:25.672591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.sql.core [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 06 09:52:25.672591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 06 09:52:25.672591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [parameters: {'id': 'f193778413424519a04662ff4f1e2c68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 06 09:52:25.672591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66751) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 06 09:52:25.686542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f193778413424519a04662ff4f1e2c68.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f193778413424519a04662ff4f1e2c68. Apr 06 09:52:25.687769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 396/792] 10.222.0.11 () {60 vars in 1161 bytes} [Wed Apr 6 09:52:25 2022] POST /identity/v3/projects => generated 262 bytes in 115 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:25.694097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:25.703184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d307029-0b93-4cc3-85ed-f0b4b340b3bb None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:25.707250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:25.707957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:25.708244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:25.708523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:25.717181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:25.742328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:25.756316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-f67176ea-0850-466e-83d5-8dfbf7e85ba7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:25.757296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 397/793] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:25.763739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:25.773252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9ca-8f1c-43d5-930d-956c9d2faebc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:25.777894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:25.778488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:25.778778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:25.779059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:25.779770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:25.780096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:25.806204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce6f90-9bfc-4d7a-89b6-b28ec52840d4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:25.823298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 397/794] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:28.018969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5877a-66a0-42f8-8997-1cd0df536c0a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:28.019448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5877a-66a0-42f8-8997-1cd0df536c0a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:28.019571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5877a-66a0-42f8-8997-1cd0df536c0a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:28.021183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 398/795] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:28.026320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:28.026752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:28.026898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:28.048859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:28.050336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:28.057667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 398/796] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:28 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:28.081231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5877a-66a0-42f8-8997-1cd0df536c0a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:28.092656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5877a-66a0-42f8-8997-1cd0df536c0a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:28.096495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:28.097077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:28.097361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:28.097636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:28.098308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:28.123723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:28.125017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.common [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 06 09:52:28.198323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.sql.core [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 06 09:52:28.198323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 06 09:52:28.198323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [parameters: {'user_id': '10c0929ac958428d8b9a50634bfba913', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 06 09:52:28.198323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66752) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 06 09:52:28.211399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 06 09:52:28.213118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 399/797] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 09:52:28 2022] POST /identity/v3/users => generated 160 bytes in 132 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:28.219191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:28.227902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29340ca7-1752-464f-8490-204eb3ffbc2e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:28.232254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:28.232921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:28.233209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:28.233496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:28.246474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:28.272396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:28.290048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-28aafd15-9188-48c9-b96f-89deaf4956ed admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 09:52:28.291112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 399/798] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:52:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:28.297376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:28.309400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0337855-f8d0-4f1d-88b6-651f508685c4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:28.313449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:28.314090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:28.314380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:28.314657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:28.315414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:28.315713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:28.341613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01e8e2-2ad4-4c78-98d9-7b82a0f6fb4f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:28.372723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 400/799] 10.222.0.11 () {56 vars in 1122 bytes} [Wed Apr 6 09:52:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:30.465561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f0b8-04c4-4bc6-88d7-b8fe7d537bd5 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:30.466159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f0b8-04c4-4bc6-88d7-b8fe7d537bd5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:30.466159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93f0b8-04c4-4bc6-88d7-b8fe7d537bd5 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:30.467808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 400/800] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:30.472872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:30.473259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:30.473433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:30.495642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:30.497078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:30.503752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 401/801] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:30 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:30.527801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93f0b8-04c4-4bc6-88d7-b8fe7d537bd5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:30.538963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93f0b8-04c4-4bc6-88d7-b8fe7d537bd5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:30.543273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:30.543965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:30.544249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:30.544525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:30.559221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:30.585063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:30.601854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:30.603038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 401/802] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:30.608981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:30.618077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03a400-d046-48fc-b894-71b27dd6ef6f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:30.622157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:30.622746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:30.623033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:30.623313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:30.624001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:30.624302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:30.649665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3238-25f7-4506-88fc-28f001162e4c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:30.662269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 402/803] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:30.668180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:30.677331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af7c3-9e85-41df-9a44-4853419681db admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:30.682000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:30.682582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:30.682868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:30.683148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:30.683792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:30.709047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb643b-c449-4572-97a5-b66e87af52f3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:30.787162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 402/804] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:52:30 2022] POST /identity/v3/users => generated 249 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:52:32.765624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ce30-7224-4f02-8435-aa6ee32d4560 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:32.766196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ce30-7224-4f02-8435-aa6ee32d4560 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:32.766196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ce30-7224-4f02-8435-aa6ee32d4560 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:32.767879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 403/805] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:32.773141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:32.773537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:32.773703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:32.796235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:32.797351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:32.804184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 403/806] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:32 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:32.826279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ce30-7224-4f02-8435-aa6ee32d4560 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:32.838190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ce30-7224-4f02-8435-aa6ee32d4560 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:32.842070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:32.842767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:32.843048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:32.843323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:32.854940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:32.861238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:52:32.862356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 404/807] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:32.868354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:32.876844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cf15c-ac5b-42cb-864f-56dac51fdd3f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:32.880881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:32.881463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:32.881752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:32.882069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:32.882778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:32.883074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:32.910127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:32.918676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 404/808] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:52:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:32.924258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:32.933982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80d50-80dd-4edb-ae72-9739bd42ed49 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:32.938267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:32.938982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:32.939270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:32.939551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:32.951419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:32.977053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:32.994511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:32.995601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 405/809] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:33.001257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.011315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8fcf-ba01-4e8d-861b-6d6d439620d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.015362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.016019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.016227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.016507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.017195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:33.017488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.043637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.057873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 405/810] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:33.063520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.073581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8115-41e0-4aa4-a193-1d2dc91d9a45 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.077662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.078403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.078694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.078975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.092075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.117089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.134919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 09:52:33.135956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 406/811] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:33.141394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.151204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc65f4a-361e-456e-b867-42868e4f182d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.155250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.155920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.156206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.156488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.157270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:33.157572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.183009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.212489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 406/812] 10.222.0.11 () {56 vars in 1160 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:33.217925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.227179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4468a51-2850-4774-b761-41529aaec41e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.231288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.231849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.232139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.232426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.239890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.265792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.275686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 407/813] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:52:33.280977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.290391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ceaad-6816-4434-94f6-b9a8b00e77b2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.294475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.295190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.295480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.295765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.307734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.333553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.349865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:33.350944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 407/814] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:33.357558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.365828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c71f-f1b5-41a3-9cc8-428362e2dbb1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.370821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.371400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.371686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.371965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.372645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:33.372942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.398125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.410522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 408/815] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:33.415756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.424788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528605c-be7e-409d-8076-a7fce9a968b8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.428747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.429477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.429768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.430653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.440407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.468284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.482996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:33.484099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 408/816] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:33.489964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.500410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea38f1-28d7-4746-bec3-db5dcb2afa0b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.504474 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.505048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.505331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.505613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.506384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:33.506684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.532203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4c49-1c3b-486a-a092-618e33e0df54 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.546553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 409/817] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:33.552469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:33.562482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedac6-6992-4b94-8fca-bee330999034 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:33.566793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:33.567363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:33.567653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:33.567939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:33.568714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=2c0d2de121404193950d51be23d2f57a) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:33.569017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:33.595074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff71c-1f86-43f4-8ec8-85eef21bf05e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:33.600226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 409/818] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:52:33 2022] GET /identity/v3/role_assignments?user.id=2c0d2de121404193950d51be23d2f57a&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:35.552408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ced5-0e4f-4173-82f5-1aa52ed789d7 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.552964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ced5-0e4f-4173-82f5-1aa52ed789d7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.552964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5ced5-0e4f-4173-82f5-1aa52ed789d7 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.554673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 410/819] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:35.560251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.560689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.560822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.584079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:35.585184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:35.592225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 410/820] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:35 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:52:35.613486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5ced5-0e4f-4173-82f5-1aa52ed789d7 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.625520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5ced5-0e4f-4173-82f5-1aa52ed789d7 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.629343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.630070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.630353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.630626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.643056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:35.653346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:52:35.654528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 411/821] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:35.660468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.669180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a25b-06e0-43e8-8c67-ceec07e651b7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.673250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.673838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.674156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.674437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.675141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:35.675436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:35.702185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:35.710337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 411/822] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:52:35.715780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.725306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9e12-b447-471e-85b0-ef4736f4ff51 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.729345 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.730067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.730353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.730628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.741437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:35.767504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:35.784499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:35.785535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 412/823] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:35.790939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.799968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53f37-93fb-4d4d-a46d-553cf5a4c969 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.804063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.804583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.804872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.805700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.806484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:35.806782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:35.831864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:35.844683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 412/824] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:35.849973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.859568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ec71-f959-47d1-9bb1-e96977980cbe admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.863617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.864314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.864601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.864878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.877271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:35.903406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:35.920487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 09:52:35.921518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 413/825] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:35.926928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:35.936195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c8452-55d7-4994-a867-549480d24fa3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:35.940324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:35.941174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:35.941467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:35.941750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:35.942571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:35.942869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:35.969168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:35.997839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 413/826] 10.222.0.11 () {56 vars in 1160 bytes} [Wed Apr 6 09:52:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:36.003346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:36.013059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618325c7-a911-4eae-aa12-ccac4f29e156 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:36.017023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:36.017727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:36.018045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:36.018324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:36.030367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:36.056754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:36.073394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:36.074466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 414/827] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:36.079864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:36.089302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6bd18-1304-496a-94e2-0e452779fdbb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:36.093267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:36.093845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:36.094164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:36.094444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:36.095124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:36.095421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:36.122228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:36.134246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 414/828] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:36.139526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:36.148472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce603-4259-431f-901d-243622b9fb60 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:36.152562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:36.153254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:36.153539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:36.153816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:36.162563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:36.188564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:36.202250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:36.203279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 415/829] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:36.208578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:36.217944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7047b-bde2-4c9b-9b80-b279f715bb47 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:36.221887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:36.222486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:36.222770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:36.223048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:36.223780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:36.224085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:36.250387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21808126-7cc0-4eb2-8e98-0d84bfb2f156 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:36.265098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 415/830] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:36.270713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:36.279730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecced-3431-4df1-825d-0599e1f53b02 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:36.283724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:36.284512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:36.284796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:36.285073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/2c0d2de121404193950d51be23d2f57a/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:36.304619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=2c0d2de121404193950d51be23d2f57a, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:36.331923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f003a-ec27-4c90-afbb-dae7f87511ad admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:36.404825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 416/831] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:52:36 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/2c0d2de121404193950d51be23d2f57a/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:52:38.339035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628dea-03d4-48dc-b335-e4bfb6ab7e09 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.339584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628dea-03d4-48dc-b335-e4bfb6ab7e09 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.339584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628dea-03d4-48dc-b335-e4bfb6ab7e09 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.341274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 416/832] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:38.346364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.346785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.346945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.370516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:38.371655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:38.433052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 417/833] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:38 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:38.455330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d628dea-03d4-48dc-b335-e4bfb6ab7e09 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.466879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d628dea-03d4-48dc-b335-e4bfb6ab7e09 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.470721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.471430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.471719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.472001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.483404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:38.489648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:52:38.490740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 417/834] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:38.497001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.505545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b8cf0-52d2-45b8-ac25-46f3850718ae None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.509651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.510271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.510557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.510831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.511529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:38.511824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.536840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.545646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 418/835] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:38.550972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.560603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48944-71a0-4aa6-b08a-52bcc4d7e34f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.564641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.565329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.565613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.566175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.577001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.603289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.620278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:38.621351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 418/836] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:38.630231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.639481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cc69-81cd-4ca1-83c0-8253481d015b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.643503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.644087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.644371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.644649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.645338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:38.645654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.675561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.688538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 419/837] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:38.694506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.703892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb65f-5520-413a-83c5-eb4f0771ac5d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.707925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.708636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.708921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.709200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.722094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.748473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.765544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 09:52:38.766619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 419/838] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:38.772333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.782238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847308-345a-4f80-895e-0b8974482fdc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.786324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.786913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.787203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.787486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.788272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:38.788575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.814171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.844616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 420/839] 10.222.0.11 () {56 vars in 1160 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:52:38.850212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.860029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f77752-a5ba-4696-88c0-d4ac1f35f968 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.863973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.864535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.864820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.865105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.873085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.900075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.909447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 420/840] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:52:38.915180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:38.924251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82ffb8-9cbd-4dfa-9143-9c29cb3cf15f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:38.928296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:38.929003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:38.929289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:38.929566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:38.941514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:38.967601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:38.985136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:38.986487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 421/841] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:38.991877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:39.000598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d97186-aea6-4d9f-b4f6-80292c3b70d4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:39.005006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:39.005592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:39.005910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:39.006225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:39.006920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:39.007223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:39.033424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:39.045426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 421/842] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:39.051048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:39.060341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acc57-dadb-4940-9947-57194be87b5d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:39.064305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:39.065006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:39.065290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:39.065566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:39.075038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:39.100338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:39.113844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:39.114852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 422/843] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:39.120526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:39.129623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7db8d-393f-48a1-8024-0a2557e0c404 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:39.134163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:39.134734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:39.135020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:39.135299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:39.136032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:39.136332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:39.162197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f59036-a0c3-4bb3-89c9-0d2e64feab01 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:39.174742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 422/844] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:39.180257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:39.189152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de46565-e163-4b0e-99d9-0c0c1e7ff0eb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:39.193336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:39.193891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:39.194208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:39.194484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:39.195244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=2c0d2de121404193950d51be23d2f57a) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:39.196080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:39.221107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd42a09-d57e-4e0a-b1fc-4303378e05a5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:39.226592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 423/845] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:52:39 2022] GET /identity/v3/role_assignments?user.id=2c0d2de121404193950d51be23d2f57a&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:41.204030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4aed5-b3f1-4d84-bc91-b3934f2fde37 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:41.204581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4aed5-b3f1-4d84-bc91-b3934f2fde37 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:41.204581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4aed5-b3f1-4d84-bc91-b3934f2fde37 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:41.206302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 423/846] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:41.211769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:41.212260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:41.212546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:41.234679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:41.235738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:41.242291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 424/847] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:41 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:41.263756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4aed5-b3f1-4d84-bc91-b3934f2fde37 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:41.276023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4aed5-b3f1-4d84-bc91-b3934f2fde37 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:41.279958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:41.280659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:41.280947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:41.281228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:41.281843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:41.306981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:41.317360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 09:52:41.318431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 424/848] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:41 2022] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:41.324444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:41.332730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e1b44-6b97-46ed-a112-81430bcabae9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:41.336738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:41.337328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:41.337609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:41.337886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:41.338581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] RBAC: Adding query filter params (name=network) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:41.338877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:41.363889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea5453-bfc9-464b-be26-83dbf9681f1d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:41.369121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 425/849] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:41.374457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:41.383596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfbd2-9b51-4c3f-b6f2-79c0f184c419 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:41.387607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:41.388172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:41.388460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:41.388741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:41.389406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] RBAC: Adding query filter params (type=network) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:41.389703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:41.415381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574e447-41a6-456f-8438-d37af414858f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:41.419925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 425/850] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:43.411766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6464a-623a-4abb-883e-9cfcc55ba020 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:43.412287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6464a-623a-4abb-883e-9cfcc55ba020 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:43.412374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6464a-623a-4abb-883e-9cfcc55ba020 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:43.414012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 426/851] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:43.419683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60393a3-1fc5-44cc-993c-2df7125b36db None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:43.420076 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60393a3-1fc5-44cc-993c-2df7125b36db None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:43.420250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60393a3-1fc5-44cc-993c-2df7125b36db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:43.443577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f60393a3-1fc5-44cc-993c-2df7125b36db None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:43.444908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f60393a3-1fc5-44cc-993c-2df7125b36db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:43.451810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 426/852] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:43 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:43.473370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6464a-623a-4abb-883e-9cfcc55ba020 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:43.485268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6464a-623a-4abb-883e-9cfcc55ba020 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:43.489172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:43.489748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:43.490059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:43.490503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:43.491179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:43.516403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd53d-2aaa-4790-9e64-34aac59c47a9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:43.586716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 427/853] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:52:43 2022] POST /identity/v3/services => generated 240 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:45.552726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5982-e415-4d10-b932-6002350f1957 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.553244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5982-e415-4d10-b932-6002350f1957 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.553335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5982-e415-4d10-b932-6002350f1957 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.555011 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 427/854] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:45.560135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.560514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.560691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.582689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:45.583806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:45.600857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 428/855] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:45 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:52:45.623259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5982-e415-4d10-b932-6002350f1957 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:45.635370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5982-e415-4d10-b932-6002350f1957 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:45.639270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:45.639974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.640263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.640546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] PATH_INFO: `/v3/services/network` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.641171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:45.667051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:45.677168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 09:52:45.678241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 428/856] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:45 2022] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:45.684019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:45.692661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30d64-ef7c-4ad4-94d8-aacca34b89f9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:45.697204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:45.697780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.698102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.698383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.699052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:45.699351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:45.724868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:45.730008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 429/857] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:45.735121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:45.744519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce121c2-25e9-469c-b5e9-5a9b18121c2f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:45.748516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:45.749083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.749372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.749652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.750347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:45.750646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:45.776626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:45.781188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 429/858] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:45.786506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:45.795647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82f85-7650-45a7-aa2a-17bba3a42436 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:45.799621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:45.800184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.800467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.800742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.801471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] RBAC: Adding query filter params (interface=public, service_id=e11f77b7038a4aa8bf3bb000d3f2e8d4, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:45.801769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:45.827251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85a68-221b-4a5e-8580-de6e70422413 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:45.832169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 430/859] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:52:45 2022] GET /identity/v3/endpoints?service_id=e11f77b7038a4aa8bf3bb000d3f2e8d4&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:45.838091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:45.846955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ef2-f3d9-4d5d-84e8-f99e45a60951 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:45.850985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:45.851553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:45.851942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:45.852228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:45.852872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:45.877734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d28da-bdd3-4088-8e74-22e664fb6277 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:45.884560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 430/860] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:52:45 2022] GET /identity/v3/services => generated 1967 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 09:52:47.855813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4952a95-8c3e-4496-9f89-cc21ceea3421 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:47.856337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4952a95-8c3e-4496-9f89-cc21ceea3421 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:47.856446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4952a95-8c3e-4496-9f89-cc21ceea3421 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:47.858079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 431/861] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:47.863208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:47.863572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:47.863789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:47.887152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:47.888306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:47.895157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 431/862] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:47 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:47.918150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4952a95-8c3e-4496-9f89-cc21ceea3421 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:47.929541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4952a95-8c3e-4496-9f89-cc21ceea3421 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:47.934111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:47.934814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:47.935102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:47.935377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] PATH_INFO: `/v3/services/network` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:47.935996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:47.960885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:47.971279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 09:52:47.972343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 432/863] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:47 2022] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:47.978758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:47.987252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6e7e-f84c-466a-ad1d-9f49b3e7bf10 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:47.991317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:47.991899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:47.992206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:47.993102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:47.993778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:47.994114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:48.019019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:48.023745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 432/864] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:48.029160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:48.038288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d840c-3914-4f33-b4ef-8bf621e5c1ea admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:48.042893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:48.043468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:48.043755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:48.044036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:48.044699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:48.044997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:48.070482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350cd46-c8af-4887-9c43-87a34b4c3223 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:48.075034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 433/865] 10.222.0.11 () {56 vars in 1133 bytes} [Wed Apr 6 09:52:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:48.080285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:48.089295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c8c8-2b73-4a6f-9950-846dc61d5241 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:48.093383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:48.093986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:48.094281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:48.094568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:48.095253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:48.121187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89039-d0aa-4180-a7fd-18a1728c14be admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:48.192745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 433/866] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:52:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:50.251352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ae3a-52cf-4c44-85d7-f0f5444790a6 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:50.251843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ae3a-52cf-4c44-85d7-f0f5444790a6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:50.251843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ae3a-52cf-4c44-85d7-f0f5444790a6 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:50.253485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 434/867] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:50.258770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:50.259351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:50.259351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:50.281456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:50.282615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:50.300635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 434/868] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:50.323264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ae3a-52cf-4c44-85d7-f0f5444790a6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:50.334613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ae3a-52cf-4c44-85d7-f0f5444790a6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:50.338492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:50.339067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:50.339350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:50.339627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:50.340310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:50.365427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:50.403732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.sql.core [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 06 09:52:50.403732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 06 09:52:50.403732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [parameters: {'id': 'b931bfa991fc4ae4be6577e928b10b85', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 06 09:52:50.403732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66752) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 06 09:52:50.409515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 06 09:52:50.410635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 435/869] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 09:52:50 2022] POST /identity/v3/roles => generated 144 bytes in 88 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:50.417476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:50.426194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8ac1-3104-4134-b947-a007c15bd69f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:50.431230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:50.431978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:50.432265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:50.432544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:50.443918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:50.450755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-46300ad8-51de-4791-8cc7-8a05a18a7ae6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 09:52:50.451851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 435/870] 10.222.0.11 () {56 vars in 1135 bytes} [Wed Apr 6 09:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:50.457339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:50.466661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ecaf-14b3-4514-8fdc-6a33e729e694 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:50.470856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:50.471561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:50.471794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:50.472071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:50.472764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:50.473059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:50.499499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2555bf-2ecb-457b-ba94-1d7819b8855a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:50.507680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 436/871] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:52.506526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c126-cb3c-4eea-b200-e2efde90c957 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:52.507084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c126-cb3c-4eea-b200-e2efde90c957 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:52.507084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c126-cb3c-4eea-b200-e2efde90c957 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:52.509681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 436/872] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:52.514801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:52.515220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:52.515369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:52.538029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:52.539175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:52.545889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 437/873] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:52.569359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c126-cb3c-4eea-b200-e2efde90c957 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:52.582006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c126-cb3c-4eea-b200-e2efde90c957 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:52.586563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:52.587326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:52.587613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:52.587895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:52.598882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:52.624338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:52.641989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:52.643057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 437/874] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:52.649549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:52.658014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae1ce-e708-4315-83a0-2a0ced45f71e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:52.662011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:52.662588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:52.662869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:52.663142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:52.663815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:52.664155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:52.688650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181811c-451f-4457-ae3e-601cdef37c20 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:52.701736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 438/875] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:52.707221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:52.716496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed8f0-cf73-46d6-869e-efd8c391797c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:52.720593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:52.721188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:52.721465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:52.721747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:52.722424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:52.748944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cb796-051b-4f41-b6f3-83cee5b45307 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:52.883891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 438/876] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:52:52 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:52:54.899521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5a88-94a8-4409-8918-7ace0649c7d8 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:54.900135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5a88-94a8-4409-8918-7ace0649c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:54.900135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5a88-94a8-4409-8918-7ace0649c7d8 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:54.901740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 439/877] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:54.907089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:54.907507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:54.907663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:54.930965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:54.932095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:54.943796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 439/878] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:54.966266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5a88-94a8-4409-8918-7ace0649c7d8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:54.979160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5a88-94a8-4409-8918-7ace0649c7d8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:54.982527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1588-d849-443d-b375-59865c618114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:54.983231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1588-d849-443d-b375-59865c618114 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:54.983514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1588-d849-443d-b375-59865c618114 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:54.983787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1588-d849-443d-b375-59865c618114 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:54.995659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1588-d849-443d-b375-59865c618114 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:55.001946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-573a1588-d849-443d-b375-59865c618114 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:52:55.003015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 440/879] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:55.008844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.017374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e61378-3ffb-4ca9-9e9c-18082bceb13d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.021472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.022094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.022387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.022676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.023934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.024349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.049912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.058145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 440/880] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:55.063438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1588-d849-443d-b375-59865c618114 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.073518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1588-d849-443d-b375-59865c618114 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.077496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.078211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.078498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.078775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.090619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.116465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.134780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:55.135857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 441/881] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:55.141755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.151590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670373a-9952-4fcb-a75b-c2a206925877 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.155597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.156175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.156462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.156744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.157429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.157728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.183673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.197418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 441/882] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:55.202823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.212793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143eef87-3f4c-4992-8952-a4f86047cc45 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.216779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.217465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.217747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.218056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.230695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.256472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.274788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:52:55.275825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 442/883] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:55.281452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.290632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b589c1e-f441-476e-b49c-ed5afd2f3550 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.294748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.295334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.295622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.295904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.296692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.296992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.323434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.351362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 442/884] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:55.356989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.366045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425c29b-ae39-4bf3-8d15-1f471eb16c22 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.370774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.371333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.371621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.371903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.379348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.404730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.413770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 443/885] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:52:55.419978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.431011 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0ca5-6115-4d6c-b02a-54ca09b3761b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.433980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.434688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.434978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.435259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.447109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.472372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.490420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:55.491485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 443/886] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:55.497775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.506123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cf8b5-6330-4361-b133-9fabc1d2c114 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.510491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.511065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.511352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.511637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.512311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.512612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.537240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.551571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 444/887] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:55.557662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.566914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518abca6-6823-47a7-adcc-862d9e35281c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.570941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.571799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.572140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.572517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.582244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.608134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.622378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:55.623473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 444/888] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:55.629263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.638815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb05565-8ece-4b27-9e96-f5d026c68316 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.642855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.643429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.643716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.643997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.644739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.645040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.670495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1b21-3ecc-4bbd-bca3-fe11f272ecd2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.683769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 445/889] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:55.689578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:55.698913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6591f-d5a0-4633-8192-c426ed60c04d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:55.702963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:55.703529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:55.703818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:55.704100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:55.704871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=050f0daf1aca4b498319ce5c265ec2b1) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:55.705176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:55.731334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ebfd6-df95-4d16-bcd6-762616f50902 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:55.736472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 445/890] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:52:55 2022] GET /identity/v3/role_assignments?user.id=050f0daf1aca4b498319ce5c265ec2b1&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:57.661109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a62b8-cd6e-48f9-9bdf-d0b8ee640419 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.661633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a62b8-cd6e-48f9-9bdf-d0b8ee640419 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.661723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a62b8-cd6e-48f9-9bdf-d0b8ee640419 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.663385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 446/891] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:52:57.669089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.669507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.669656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.692713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:52:57.693831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:52:57.700736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 446/892] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:52:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:52:57.722276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a62b8-cd6e-48f9-9bdf-d0b8ee640419 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:57.734683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a62b8-cd6e-48f9-9bdf-d0b8ee640419 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:57.738570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:57.739269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.739554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.739829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.751358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:52:57.757846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:52:57.758909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 447/893] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:57.764588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:57.772978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757aef5-7522-47e8-881b-ac4c02cc5d23 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:57.777100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:57.777684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.778008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.778296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.779004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:57.779305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:57.804778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:57.812905 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 447/894] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:57.818453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:57.828717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c51160-4111-40d0-abd0-2c6ef7119a50 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:57.832760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:57.833447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.833733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.834050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.844981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:57.871096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:57.888046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:57.889085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 448/895] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:57.894615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:57.903819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985450b-6595-4e93-a4a6-1c546697185f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:57.907901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:57.908475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.908765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.909045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.909727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:57.910065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:57.936281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:57.949176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 448/896] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:57.954672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:57.963780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3494af-a631-4cc5-86fc-9bb286b085fd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:57.967856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:57.968559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:57.968845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:57.969124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:57.982424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.008814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.026555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:52:58.027610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 449/897] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:52:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:58.033236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.043271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df1bd-f66c-4090-900d-a22a7b724c46 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.047344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.047932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.048221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.048506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.049291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:58.049594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.075251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.104192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 449/898] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:52:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:58.109545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.118784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5bca-8cdc-4830-942b-a773d7cbf0d3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.122806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.123496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.123777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.124050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.136044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.161221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.178089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:52:58.179119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 450/899] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:58.186890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.196306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00286-9f5c-40fc-b6f9-4779b37bc431 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.200417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.201005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.201298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.201586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.202321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:58.202622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.229025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.241553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 450/900] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:58.246969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.255984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51936502-ab6c-4fce-a3f9-eb900982f41a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.260038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.260742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.261027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.261304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.270068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.296659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.310114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:52:58.311167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 451/901] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:52:58.317027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.326139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58501-8606-4304-9228-56b17dd38343 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.330258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.330836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.331129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.331414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.332157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:52:58.332460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.359074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b82056-18e7-492e-b8b5-e2a55bc513af admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.371806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 451/902] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:52:58.377321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:52:58.386915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74615-3041-42cb-be83-bf461e901fff admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:52:58.390885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:52:58.391671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:52:58.391955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:52:58.392234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/050f0daf1aca4b498319ce5c265ec2b1/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:52:58.412047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=050f0daf1aca4b498319ce5c265ec2b1, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:52:58.437849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40b8f3-ea06-401a-b9c3-4555c89ab649 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:52:58.524602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 452/903] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:52:58 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/050f0daf1aca4b498319ce5c265ec2b1/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:53:00.465092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1284c-815a-4456-882c-fe233e85f0d4 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.465614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1284c-815a-4456-882c-fe233e85f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.465730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1284c-815a-4456-882c-fe233e85f0d4 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.467383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 452/904] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:00.472502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.472904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.473099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.495623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:00.497017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:00.559962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 453/905] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:00.582451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1284c-815a-4456-882c-fe233e85f0d4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.594294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1284c-815a-4456-882c-fe233e85f0d4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.598178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.598887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.599177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.599460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.610879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:00.617186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 09:53:00.618270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 453/906] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:00.623808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.632178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396521-e26c-47a2-812b-20647e6da2b6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.636816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.637402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.637690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.638005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.638718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:00.639020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:00.664316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:00.672559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 454/907] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:00.678151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.687655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28c4a-29a5-4d4c-bb04-b476bebba238 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.691936 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.692624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.692912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.693194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.704517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:00.730237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:00.748577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:00.749619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 454/908] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:00.755052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.764625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e892753-4d43-4bdb-b90f-888a6a43cba4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.768673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.769244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.769529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.769807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.770510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:00.770810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:00.796296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:00.809177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 455/909] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:00.814489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.823930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9bba-feec-4812-9d57-0a40fb7a1060 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.828182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.828887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.829175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.829457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.918141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:00.944203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:00.962815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:53:00.963916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 455/910] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:00.970156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:00.980306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a6ee1-2281-4302-8ef0-11638ed4f5eb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:00.984256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:00.984845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:00.985128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:00.985405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:00.986218 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:00.986515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.012544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.120164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 456/911] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:53:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:01.126189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.136215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259177-5e85-4513-90a1-32ca9e060522 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.140273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.140845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.141131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.141412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.148803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.173728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.182506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 456/912] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:01.187942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.197997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d6455-ad3a-4689-9e85-f83370988957 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.201900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.202620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.202901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.203174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.214297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.239179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.255786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:01.256818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 457/913] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:01.262870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.271151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748c48-6855-4f82-bde7-693d3a53c45e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.275275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.275933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.276222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.276505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.277182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:01.277481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.302272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.315357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 457/914] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:01.320852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.330377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae11e-6ea1-4ade-8197-dab2046a5553 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.334304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.334997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.335278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.335553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.344156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.369794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.382835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:53:01.383869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 458/915] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:01.389377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.398365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce083b01-8567-4130-9f70-2803c48bff49 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.402632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.403200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.403487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.403768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.404505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:01.404806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.431211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427aebd-81f6-4b0a-8791-24aada644ea1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.444548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 458/916] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:01.450373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:01.459346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b73e1-e5ce-43ad-9d89-58e398549b5f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:01.463454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:01.464017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:01.464316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:01.464574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:01.465339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=050f0daf1aca4b498319ce5c265ec2b1) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:01.465678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:01.491046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb00c06-8bff-4c34-9ece-4fe409d086b3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:01.496903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 459/917] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:01 2022] GET /identity/v3/role_assignments?user.id=050f0daf1aca4b498319ce5c265ec2b1&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:03.499595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145bb74-05eb-4656-9d01-15eace77fc64 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.500187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145bb74-05eb-4656-9d01-15eace77fc64 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.500187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145bb74-05eb-4656-9d01-15eace77fc64 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.501854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 459/918] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:03.507033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.507465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.507605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.530366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:03.531481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:03.538129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 460/919] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:03.560777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145bb74-05eb-4656-9d01-15eace77fc64 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.572626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145bb74-05eb-4656-9d01-15eace77fc64 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.576523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.577226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.577512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.577794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.589271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:03.595562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:03.596635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 460/920] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:03.602168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.611119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617edfc-cafd-45da-8b9c-52a0e35add62 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.615170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.615748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.616039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.616310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.617010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:03.617306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.642229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:03.651127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 461/921] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:03.656600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.666592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8f2db-a621-4dd7-856b-bc69e6d2eec6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.670613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.671309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.671592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.671868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.683132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.709289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:03.727202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:03.728833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 461/922] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:03.734296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.743445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1003-4e43-424e-b2f3-6802fac5195a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.747713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.748289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.748576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.748855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.749537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:03.749881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.775388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:03.787710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 462/923] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:03.793149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.802071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dd872-c4e0-4bb8-9161-c430aa5ed9ca admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.806449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.807142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.807428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.807705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.820085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.847314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:03.864683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:53:03.865718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 462/924] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:03.871395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.880357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0801-afb4-4b26-b6b6-b3cfe6b1e5f5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.884942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.885520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.885803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.886118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.886898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:03.887198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.912810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:03.941363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 463/925] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:03.947979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:03.957203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedf93-bf03-4f24-aa1d-602eaef08349 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:03.961258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:03.962466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:03.962770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:03.963051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:03.970602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:03.996071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.005415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 463/926] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:04.011749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:04.020838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b235c-b25c-4fda-a8b9-f1fba98ed2bf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:04.024878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:04.025585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:04.025872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:04.026185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:04.037271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:04.062686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.079766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:04.080811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 464/927] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:04.086177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:04.094476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6fc46-120e-48c9-babd-68e2e655565d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:04.098464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:04.099031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:04.099316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:04.099592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:04.100262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:04.100562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:04.126438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.138593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 464/928] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:04.143854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:04.152851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634d86-e0f4-4941-a28f-115aee5ecb20 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:04.156848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:04.157538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:04.157825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:04.158131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:04.166855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:04.192264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.205569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:53:04.206626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 465/929] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:04.212882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:04.221753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c011d1-096f-4e1a-ab02-25752d140c10 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:04.225796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:04.226399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:04.226683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:04.226962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:04.228732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:04.229034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:04.254368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a87a2-ebba-4437-ba44-15d1a2b9bbe5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.267200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 465/930] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:04.272642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:04.282520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef8cc-eaaf-408f-83aa-30dcd3057a5d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:04.286549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:04.287109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:04.287395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:04.287674 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:04.288445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=050f0daf1aca4b498319ce5c265ec2b1) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:04.288749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:04.314072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e27a-f9d9-4dcd-9dc6-121e623726bc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:04.319508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 466/931] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:04 2022] GET /identity/v3/role_assignments?user.id=050f0daf1aca4b498319ce5c265ec2b1&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:06.313300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2590b-1846-43bb-97ea-157b0366e862 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.313819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2590b-1846-43bb-97ea-157b0366e862 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.313903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2590b-1846-43bb-97ea-157b0366e862 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.315785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 466/932] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:06.320789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.321158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.321406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.344312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:06.345436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:06.352170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 467/933] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:06.374867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2590b-1846-43bb-97ea-157b0366e862 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.386791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2590b-1846-43bb-97ea-157b0366e862 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.390635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.391338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.391623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.391901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.402674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:06.408849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:06.409917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 467/934] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:06.415792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.424264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a6e0-a4ca-4fec-8a5c-a17414e2c768 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.428340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.428925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.429214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.429730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.430229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:06.431026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.456571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.465064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 468/935] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:06.470739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.481354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d440a6-0483-480f-b12d-bb72195714f3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.485589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.486343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.486637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.486923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.498907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.524700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.542157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:06.543257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 468/936] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:06.549053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.558867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd6d4-a2d5-425d-ab23-19fc2baaa1ef admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.562969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.563596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.563838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.564121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.564814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:06.565117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.590816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.603852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 469/937] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:06.609136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.618306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b040-e31b-42c2-8c4b-731463f84a20 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.622407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.623104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.623393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.623675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.636456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.662450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.679728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:53:06.680930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 469/938] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:06.686555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.696048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec994fe-8562-455b-a41c-0dd3d187a3b7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.700894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.701481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.701767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.702118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.702867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:06.703194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.728660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.758088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 470/939] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:06.764232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.773324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cae27-2077-448f-a8ee-64df777d0ee1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.778174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.778884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.779173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.779454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.792661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.818056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.835051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:06.836127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 470/940] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:06.842350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.851394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c6c1-ee33-47aa-9ebc-7544cb1eb27d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.855741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.856321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.856606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.856882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.857559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:06.857855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.882725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.895465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 471/941] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:06.901411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.910501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6e6b-f9bc-4a71-8a50-9faca83b1539 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.914505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.915439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.915554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.915840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.924566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:06.950471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:06.964560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:53:06.965636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 471/942] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:06.971287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:06.980730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350274f0-f510-4a4f-933d-6e7cfb946050 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:06.984839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:06.985420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:06.985705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:06.986008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:06.986752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:06.987050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:07.013710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de594f2a-288d-425b-8de5-d2dcbdc3666d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:07.026902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 472/943] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:07.032962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:07.042291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94df7-c378-464f-9a52-4f87a4cb6c21 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:07.046315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:07.047106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:07.047390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:07.047664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/050f0daf1aca4b498319ce5c265ec2b1/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:07.049384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=050f0daf1aca4b498319ce5c265ec2b1, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:07.076262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f53a3-5304-4c18-b5a0-f2f00e4e009a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:07.175080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 472/944] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:53:07 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/050f0daf1aca4b498319ce5c265ec2b1/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:53:09.144628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26edba-8830-4cba-b54d-e17d71acd15a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.145164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26edba-8830-4cba-b54d-e17d71acd15a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.145270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26edba-8830-4cba-b54d-e17d71acd15a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.146916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 473/945] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:09.154427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.154826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.154994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.177796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:09.178938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:09.241382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 473/946] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:09.264363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26edba-8830-4cba-b54d-e17d71acd15a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.276404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26edba-8830-4cba-b54d-e17d71acd15a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.280296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.280998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.281280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.281558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.293314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:09.299555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:09.300612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 474/947] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:09.306620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.315020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356fff-b0e0-4624-aa68-4d29910091a5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.319285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.319882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.320150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.320429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.321132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.321980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.347749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.357061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 474/948] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:09.362587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.372221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9757fa-218d-45d4-b621-b81d11e69a94 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.376316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.377013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.377298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.377577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.388473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.413747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.431443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:09.432486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 475/949] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:09.438006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.448050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640674f-8d39-48d6-b6a7-e75f92af0218 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.452140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.452709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.452996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.453277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.453980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.454280 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.482317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.495261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 475/950] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:09.500947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.510119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f23bc8-8fee-427d-84a7-9d7cb74d7362 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.514194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.514893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.515180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.515459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.528451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.553955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.571735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 09:53:09.572776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 476/951] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:09.578315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.587820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dbc1-5c1e-489f-b04c-0ca007baabe0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.591839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.592417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.592703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.592981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.593759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.594096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.619772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.647695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 476/952] 10.222.0.11 () {56 vars in 1156 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:09.653791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.662852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bf66-3bb2-497c-aff7-541990eab65f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.667261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.667817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.668105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.668387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.675797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.701083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.710193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 477/953] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:09.716041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.725046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1adb66-c621-4d0f-a545-4865af2104fe admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.729506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.730238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.730523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.730804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.741879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.768095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.784947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 09:53:09.786014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 477/954] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:09.791990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.800259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde661-6f55-4b50-be70-e1d2aaae58c5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.804327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.804893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.805177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.805455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.806530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.806828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.832399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.844974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 478/955] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:09.850307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.859763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4c7d-7c19-4a7e-9660-c53f5b203e84 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.863755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.864441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.864726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.865004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.873597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.899990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.913474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 09:53:09.914570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 478/956] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:53:09.920470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.929628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63701-dbc6-4cd6-b838-a642eeb79fc9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.933714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.934323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.934613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.934893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.935637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.935938 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:09.961558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad029ed-5c2a-4603-8d65-9c4ce847f8ed admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:09.975216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 479/957] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:09.981238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:09.990298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed491-2456-4ea8-8b36-8d789f03b723 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:09.995003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:09.995607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:09.995897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:09.996179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:09.996972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=050f0daf1aca4b498319ce5c265ec2b1) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:09.997276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:10.023618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65c8e2-b595-404a-879d-85a517072af8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:10.029498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 479/958] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:09 2022] GET /identity/v3/role_assignments?user.id=050f0daf1aca4b498319ce5c265ec2b1&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:12.009737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bb667-a72f-4422-a459-4dcd14243680 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:12.010241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bb667-a72f-4422-a459-4dcd14243680 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:12.010328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bb667-a72f-4422-a459-4dcd14243680 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:12.011998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 480/959] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:12.017177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:12.017586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:12.017747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:12.040402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:12.041548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:12.048209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 480/960] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:12.070624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bb667-a72f-4422-a459-4dcd14243680 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:12.082411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bb667-a72f-4422-a459-4dcd14243680 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:12.086280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:12.087176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:12.087457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:12.087734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:12.088353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:12.113493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:12.124653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 09:53:12.125711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 481/961] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:53:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:12.131674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:12.140693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88743b9-c2bf-4e90-9481-d793607f0451 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:12.144693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:12.145271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:12.145557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:12.145837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:12.146538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:12.146837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:12.172223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb51b9-04f8-4a50-8d3d-e22e66b78ec5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:12.176876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 481/962] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:12.182904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:12.192229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c125d3b-bb85-4819-a5d8-c606b3b1d40b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:12.196270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:12.196844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:12.197127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:12.197406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:12.198119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:12.198701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:12.223350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6f8e-bf5d-486c-8a7d-ca6149910877 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:12.228153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 482/963] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:14.208762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656ad8-0aa8-415f-b52e-d273bd3903f8 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:14.209315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656ad8-0aa8-415f-b52e-d273bd3903f8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:14.209315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656ad8-0aa8-415f-b52e-d273bd3903f8 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:14.211008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 482/964] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:14.216472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7894a-2ba5-4ebd-9273-497c55da3984 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:14.216889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7894a-2ba5-4ebd-9273-497c55da3984 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:14.217035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7894a-2ba5-4ebd-9273-497c55da3984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:14.239648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5be7894a-2ba5-4ebd-9273-497c55da3984 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:14.240700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5be7894a-2ba5-4ebd-9273-497c55da3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:14.248034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 483/965] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:14.270201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656ad8-0aa8-415f-b52e-d273bd3903f8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:14.281756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656ad8-0aa8-415f-b52e-d273bd3903f8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:14.285656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:14.286264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:14.286549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:14.286827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:14.287526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:14.313818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c254b-f64f-4400-9856-de97430f76d5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:14.386547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 483/966] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:53:14 2022] POST /identity/v3/services => generated 241 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:53:16.383581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd222-c18b-4f12-9cf2-28a4c2c27fe4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.384187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd222-c18b-4f12-9cf2-28a4c2c27fe4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.384473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd222-c18b-4f12-9cf2-28a4c2c27fe4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.386185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 484/967] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:16.391187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.391575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.391753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.413857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:16.415963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:16.433489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 484/968] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:16 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:16.455784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfd222-c18b-4f12-9cf2-28a4c2c27fe4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:16.467258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfd222-c18b-4f12-9cf2-28a4c2c27fe4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:16.471185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:16.471896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.472180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.472456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.473073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:16.498852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:16.509806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 09:53:16.510871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 485/969] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:53:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:16.516561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:16.525495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e70c5-d160-4e04-b3de-3661a1934f5e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:16.529484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:16.530097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.530384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.530662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.531332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:16.531630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:16.556631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:16.561345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 485/970] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:16.566984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:16.576537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41158-c7c6-4d26-8638-d841813b290e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:16.580637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:16.581213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.581502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.581785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.582489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:16.582791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:16.608058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:16.612636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 486/971] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:16.618324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:16.627197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f20f-fad4-42e6-bf0e-3f4ad033a3ff admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:16.631273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:16.631837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.632125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.632404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.633141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] RBAC: Adding query filter params (interface=public, service_id=b267a31402da447ab4e2c5cb9d687ae0, region_id=RegionOne) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:16.634035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:16.660051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5564a-ca41-4005-b323-1dc3a2096496 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:16.665113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 486/972] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 09:53:16 2022] GET /identity/v3/endpoints?service_id=b267a31402da447ab4e2c5cb9d687ae0&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:16.670277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:16.679200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5c3a-ef40-4b36-b63f-817b48d2db6c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:16.683302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:16.683870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:16.684157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:16.684437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:16.685105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:16.710390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7279fb-8731-4be0-ad01-d977c70395a6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:16.717488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 487/973] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:53:16 2022] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 09:53:18.669260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da904-d632-4aa2-a151-e4a2568d29fd None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.669782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da904-d632-4aa2-a151-e4a2568d29fd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.669865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da904-d632-4aa2-a151-e4a2568d29fd None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.671524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 487/974] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:18.676772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.677197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.677339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.700128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:18.701252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:18.708029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 488/975] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:18.730131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214da904-d632-4aa2-a151-e4a2568d29fd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:18.741517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214da904-d632-4aa2-a151-e4a2568d29fd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:18.746145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:18.746866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.747155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.747438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.748065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:18.773163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:18.783789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 09:53:18.784847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 488/976] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:53:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:18.791065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:18.799392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d55805-f296-41a4-b0e6-86b596268bc8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:18.803388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:18.803962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.804246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.804527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.805188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:18.806187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:18.831073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:18.835853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 489/977] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:18.841317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:18.850268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade15e6-cc3f-49ed-bca7-c3e756a214e3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:18.854959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:18.855528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.855825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.856108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.856770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:18.857068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:18.882795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc4758-1b15-48d6-8324-79a89d245dbb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:18.887730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 489/978] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:18.893158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:18.902145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb55fd5-6367-4dd1-a00b-be070ffc6e7e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:18.906130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:18.906702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:18.906987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:18.907262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:18.907933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:18.933465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e40cc-0b2e-4e20-a0f5-8607aa1bdd94 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:19.015360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 490/979] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:53:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:53:20.982533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548e40-f1d2-4b1b-bc75-fc86fdf7fc4b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:20.982998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548e40-f1d2-4b1b-bc75-fc86fdf7fc4b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:20.983087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548e40-f1d2-4b1b-bc75-fc86fdf7fc4b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:20.984761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 490/980] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:20.990119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:20.990515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:20.990676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.013899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:21.015038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:21.032504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 491/981] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:21.054306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548e40-f1d2-4b1b-bc75-fc86fdf7fc4b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:21.069856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548e40-f1d2-4b1b-bc75-fc86fdf7fc4b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:21.074440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:21.075161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:21.075452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:21.075737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.076358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:21.101977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:21.112463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 09:53:21.113524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 491/982] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:53:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:21.119493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:21.127955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0944-1f04-417d-ba7d-f7b0e6c6d242 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:21.132060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:21.132641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:21.132927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:21.133208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.134647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:21.134949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:21.160476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:21.165241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 492/983] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:21.170608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:21.181993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841dc9-3427-4951-9961-dcb8c7e2c93b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:21.186110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:21.186674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:21.186956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:21.187341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.188003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:21.188298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:21.214750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:21.219564 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 492/984] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:21.225327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:21.235033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb9ba-90d1-4420-bf57-b896ecf1fdc5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:21.239017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:21.239588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:21.239874 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:21.240153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.240895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] RBAC: Adding query filter params (interface=admin, service_id=b267a31402da447ab4e2c5cb9d687ae0, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:21.241197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:21.267783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4e6b-260a-44f2-8ae4-7749abf39773 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:21.272798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 493/985] 10.222.0.11 () {56 vars in 1270 bytes} [Wed Apr 6 09:53:21 2022] GET /identity/v3/endpoints?service_id=b267a31402da447ab4e2c5cb9d687ae0&interface=admin®ion_id=RegionOne => generated 193 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:21.278194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:21.287065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563ea8-4be2-42db-863a-b94d973ac4dd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:21.291636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:21.292202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:21.292485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:21.292762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:21.293409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:21.318862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5ebf2-b535-4373-b184-0ae5a3ff1613 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:21.326124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 493/986] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 09:53:21 2022] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 09:53:23.291228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423cbb-1159-4476-9754-88684e6aa451 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.291763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423cbb-1159-4476-9754-88684e6aa451 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.291858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423cbb-1159-4476-9754-88684e6aa451 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.293469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 494/987] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:23.300379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.300379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.300379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.321875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:23.323261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:23.329899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 494/988] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:23.351845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0423cbb-1159-4476-9754-88684e6aa451 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:23.364300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0423cbb-1159-4476-9754-88684e6aa451 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:23.369017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:23.369726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.370047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.370330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.370954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:23.395514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:23.406357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 09:53:23.407395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 495/989] 10.222.0.11 () {56 vars in 1147 bytes} [Wed Apr 6 09:53:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:23.412996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:23.421893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360095e-96c2-44dc-9c17-d346171b385a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:23.425901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:23.426498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.426781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.427057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.427721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:23.428017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:23.453481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:23.459436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 495/990] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:23.464915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:23.473945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe81a5-e15e-4666-a490-d82609d78416 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:23.478708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:23.479279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.479564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.479841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.480499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:23.480795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:23.506130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd9485-38ed-4aea-9f52-607ffab498d7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:23.511167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 496/991] 10.222.0.11 () {56 vars in 1143 bytes} [Wed Apr 6 09:53:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:23.516450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:23.526555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8145c-784e-46d5-a223-2a5222e05340 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:23.530736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:23.531314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:23.531602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:23.531886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:23.532587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:23.558331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cb942-585c-450b-b206-028534b2b27e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:23.660981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 496/992] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 09:53:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:53:25.646595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39697-8909-436b-94b6-14cca24d9958 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:25.647223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39697-8909-436b-94b6-14cca24d9958 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:25.647223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39697-8909-436b-94b6-14cca24d9958 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:25.648857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 497/993] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:25.654046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:25.654477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:25.654603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:25.677512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:25.678643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:25.696465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 497/994] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:25.718579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39697-8909-436b-94b6-14cca24d9958 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:25.730911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39697-8909-436b-94b6-14cca24d9958 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:25.734832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:25.735525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:25.735807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:25.736083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:25.737129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:25.763332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb28469-2fbe-4cff-affb-237e994cf44d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:25.764747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 498/995] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:25.770143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:25.779202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7ea0-d5d9-41e7-9e8a-1041c08493b8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:25.783278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:25.783846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:25.784131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:25.784409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:25.785047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:25.810973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd59b5-3804-40af-bb49-03adbff98844 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:25.925250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 498/996] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:53:25 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:53:27.955725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9627c6-c8d2-4d12-93b6-fa884b94cb00 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:27.956285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9627c6-c8d2-4d12-93b6-fa884b94cb00 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:27.956738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9627c6-c8d2-4d12-93b6-fa884b94cb00 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:27.959649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 499/997] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:27.966624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:27.967168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:27.967271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:27.995816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:27.996971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:28.077168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 499/998] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:28.110267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9627c6-c8d2-4d12-93b6-fa884b94cb00 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:28.122520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9627c6-c8d2-4d12-93b6-fa884b94cb00 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:28.126413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:28.127110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:28.127391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:28.127680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:28.128731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:28.154312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268934c8-bb36-4200-ac61-d5c4fddf9d2a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:28.157446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 500/999] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:28.161556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:28.170309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25504dc0-7e31-4522-9677-1eb6921b164e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:28.175913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:28.176880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:28.177367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:28.177865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:28.179100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:28.206102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb8b67-ecb1-48a9-852d-8f005e2410f6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:28.288934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 500/1000] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:53:28 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:53:30.278486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aebbd-c3c3-4b90-85f4-efe27c8822f4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.279001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aebbd-c3c3-4b90-85f4-efe27c8822f4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.279001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aebbd-c3c3-4b90-85f4-efe27c8822f4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.280669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 501/1001] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:30.285731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.286143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.286335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.308839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:30.309981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:30.316937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 501/1002] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:30.339519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aebbd-c3c3-4b90-85f4-efe27c8822f4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.350970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aebbd-c3c3-4b90-85f4-efe27c8822f4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.354997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.355701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.355989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.356267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.370238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:30.376458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:30.377508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 502/1003] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:30.384395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.392765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ee6a-cd59-41ea-9252-b6d235612449 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.396851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.397435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.397722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.398037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.398753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:30.399511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:30.424652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:30.433719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 502/1004] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:30.439299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.449602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e698ff-4b51-4503-9efa-4dc4d53c8cff admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.453661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.454464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.454751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.455027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] PATH_INFO: `/v3/users/2810a7e9427544109bcdf9c746886128` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.474205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] RBAC: Authorizing `identity:get_user(user_id=2810a7e9427544109bcdf9c746886128)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:30.499792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:30.501272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 503/1005] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/users/2810a7e9427544109bcdf9c746886128 => generated 285 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:30.507033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.516426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a26a64-4d79-41ee-9715-7fb102c9d2be admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.520437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.521000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.521285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.521563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.529978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:30.556264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:30.564459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 503/1006] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:30.570313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.579589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800e8ac-0985-4166-a8dc-c6d652cb6438 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.583693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.584736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.585023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.585303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.587093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:30.612751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e9a8a-eebf-42d4-b025-93536a8a7c7d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:30.614279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 504/1007] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:30.620813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:30.629119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e17601-40c3-44e8-93f4-64d22960d11d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:30.633760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:30.634350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:30.634640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:30.634922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:30.635697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=20846fe3d47240a4b10b2d8af0ced17b, user.id=2810a7e9427544109bcdf9c746886128) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:30.636001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:30.661741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331f75d-0cfe-4b79-a60c-116310967fc1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:30.667029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 504/1008] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:30 2022] GET /identity/v3/role_assignments?user.id=2810a7e9427544109bcdf9c746886128&scope.project.id=20846fe3d47240a4b10b2d8af0ced17b&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:32.642336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b4cd-3140-48c8-b6d2-96aa4d44bfa9 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.642881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b4cd-3140-48c8-b6d2-96aa4d44bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.642881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b4cd-3140-48c8-b6d2-96aa4d44bfa9 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.644549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 505/1009] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:32.650407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.650810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.650976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.673301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:32.674456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:32.681556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 505/1010] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:32.703358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b4cd-3140-48c8-b6d2-96aa4d44bfa9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:32.715244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b4cd-3140-48c8-b6d2-96aa4d44bfa9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:32.719149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:32.719848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.720134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.720408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.732421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:32.738681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:32.739735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 506/1011] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:32.745481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:32.753883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e466d-2447-4a12-8dec-5b054846a36b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:32.758518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:32.758826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.759115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.759396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.760104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:32.760403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:32.785874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:32.796221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 506/1012] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:32.801808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:32.812042 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3910b-07db-4620-b552-7dfa7afeaf0e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:32.816384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:32.817160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.817442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.817718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] PATH_INFO: `/v3/users/2810a7e9427544109bcdf9c746886128` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.818823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] RBAC: Authorizing `identity:get_user(user_id=2810a7e9427544109bcdf9c746886128)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:32.845137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:32.846616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 507/1013] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:32 2022] GET /identity/v3/users/2810a7e9427544109bcdf9c746886128 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:32.852815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:32.862116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ec55-37f0-4422-a83d-964fae78715b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:32.866244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:32.867019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.867306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.867790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.868955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:32.895388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59922412-11ea-49ed-9ff7-2f37921a349b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:32.896844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 507/1014] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:32 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:32.903088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:32.912309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c4ac1-25fc-4bf0-98f7-0dbddac052ab admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:32.916446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:32.917248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:32.917534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:32.917813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b/users/2810a7e9427544109bcdf9c746886128/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:32.919591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20846fe3d47240a4b10b2d8af0ced17b, user_id=2810a7e9427544109bcdf9c746886128, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:32.946086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0e658-6b6b-4688-8034-307191873bf6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:33.054979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 508/1015] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:53:32 2022] PUT /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b/users/2810a7e9427544109bcdf9c746886128/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:53:35.004067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29f0e-721a-442a-aaa2-c3186b3ca753 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.004587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29f0e-721a-442a-aaa2-c3186b3ca753 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.004681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29f0e-721a-442a-aaa2-c3186b3ca753 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.006337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 508/1016] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:35.011942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.012360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.012506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.037291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:35.038444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:35.101232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 509/1017] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:35.128297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29f0e-721a-442a-aaa2-c3186b3ca753 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.140406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29f0e-721a-442a-aaa2-c3186b3ca753 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.144385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.145093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.145382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.145663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.157455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:35.163805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:35.165495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 509/1018] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:35.171268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.179668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dab4a-b2d8-4e91-a9ab-49ac87d0755c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.184843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.185426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.185709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.186024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.186726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:35.187025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:35.212740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:35.220952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 510/1019] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:35.226401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.235959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe70036-2284-4b1d-8256-c84a5c44f461 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.240038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.240813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.241101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.241381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] PATH_INFO: `/v3/users/2810a7e9427544109bcdf9c746886128` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.243095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] RBAC: Authorizing `identity:get_user(user_id=2810a7e9427544109bcdf9c746886128)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:35.268824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:35.270637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 510/1020] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/users/2810a7e9427544109bcdf9c746886128 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:35.276406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.285754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa668-c349-42a9-95c7-6c24681aca92 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.290381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.290950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.291245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.291526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.298997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:35.324670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:35.332998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 511/1021] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:35.338731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.347781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc19643-d0bb-49eb-86de-3077be4f1589 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.352456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.353383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.353671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.353976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.355062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:35.380475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5927e-00ae-4b93-b0c3-24d22ff98aa9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:35.382119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 511/1022] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:35.387999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:35.396400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b72f9-fe67-4361-b073-1cd2162d0b72 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:35.400881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:35.401445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:35.401734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:35.402045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:35.402814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=20846fe3d47240a4b10b2d8af0ced17b, user.id=2810a7e9427544109bcdf9c746886128) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:35.403120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:35.428341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2219-77c2-45d1-8557-fc1fc7e3c75f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:35.434608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 512/1023] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:35 2022] GET /identity/v3/role_assignments?user.id=2810a7e9427544109bcdf9c746886128&scope.project.id=20846fe3d47240a4b10b2d8af0ced17b&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:37.426661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9cd-ef3d-4b48-a976-cee742b5ab32 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:37.427221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9cd-ef3d-4b48-a976-cee742b5ab32 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:37.427221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9cd-ef3d-4b48-a976-cee742b5ab32 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:37.428886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 512/1024] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:37.433947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:37.434343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:37.434530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:37.457223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:37.458382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:37.465393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 513/1025] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:37.488720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d9cd-ef3d-4b48-a976-cee742b5ab32 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:37.501077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d9cd-ef3d-4b48-a976-cee742b5ab32 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:37.504936 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:37.505629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:37.505910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:37.506212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:37.507261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:37.533041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ab72-65c3-40b4-9f6d-4289527207d1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:37.534476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 513/1026] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:37.540211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:37.548650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3574a4-5f15-424a-bed9-b3878fb127e1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:37.552716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:37.553306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:37.553597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:37.553877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:37.554552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:37.581223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596653b-0704-44a0-b1d3-1d581d049a79 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:37.666479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 514/1027] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:53:37 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:53:39.691698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e86c-1f0d-44e2-b241-de438cabbf04 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.692221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e86c-1f0d-44e2-b241-de438cabbf04 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.692339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6e86c-1f0d-44e2-b241-de438cabbf04 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.693918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 514/1028] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:39.699469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.699898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.700033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.722481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:39.723599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:39.730568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 515/1029] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:39.752637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e86c-1f0d-44e2-b241-de438cabbf04 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:39.764629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6e86c-1f0d-44e2-b241-de438cabbf04 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:39.768528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:39.769291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.769577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.769857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] PATH_INFO: `/v3/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.771201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] RBAC: Authorizing `identity:get_role(role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:39.796169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:53:39.796169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:53:39.796169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:53:39.797031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:39.798296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 515/1030] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:39 2022] GET /identity/v3/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:39.803716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:39.812402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed58ec-87e0-4cfa-b729-083dcb167371 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:39.816772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:39.817557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.817843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.818148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] PATH_INFO: `/v3/users/48013c3fc27949a3a8e606712614aad5` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.837089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] RBAC: Authorizing `identity:get_user(user_id=48013c3fc27949a3a8e606712614aad5)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:39.862661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:39.864146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 516/1031] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:39 2022] GET /identity/v3/users/48013c3fc27949a3a8e606712614aad5 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:39.869766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:39.878913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609b327-c965-44f9-baf6-68abe2fc2cae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:39.883533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:39.884090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.884376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.884662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.892068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:39.917975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:39.926233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 516/1032] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:39.932463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:39.941841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8d1aa-c16d-43e1-99b7-e2335c8d6196 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:39.946305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:39.947070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.947353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.947631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.948702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:39.973987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e426-fd3a-413d-8d55-69c3813a34f8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:39.975513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 517/1033] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:39 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:39.981921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:39.990450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288f7f-5f9e-4a6b-ab80-51ea02a08ee8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:39.995408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:39.995976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:39.996261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:39.996539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:39.997306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=20846fe3d47240a4b10b2d8af0ced17b, user.id=48013c3fc27949a3a8e606712614aad5) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:39.997607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:40.023194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46183-7c2c-4c39-846d-111b3f105775 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:40.028825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 517/1034] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:39 2022] GET /identity/v3/role_assignments?user.id=48013c3fc27949a3a8e606712614aad5&scope.project.id=20846fe3d47240a4b10b2d8af0ced17b&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:42.001682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282190c-2929-41b7-b7c4-030d02473a57 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.002150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282190c-2929-41b7-b7c4-030d02473a57 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.002292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282190c-2929-41b7-b7c4-030d02473a57 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.003977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 518/1035] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:42.009616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e713016-a540-423b-868c-b9b2125df13a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.010061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e713016-a540-423b-868c-b9b2125df13a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.010201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e713016-a540-423b-868c-b9b2125df13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.032744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9e713016-a540-423b-868c-b9b2125df13a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:42.033852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e713016-a540-423b-868c-b9b2125df13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:42.041325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 518/1036] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:42.063745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282190c-2929-41b7-b7c4-030d02473a57 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:42.075653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282190c-2929-41b7-b7c4-030d02473a57 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:42.079618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:42.080380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.080667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.080949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] PATH_INFO: `/v3/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.082340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] RBAC: Authorizing `identity:get_role(role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:42.107307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:53:42.107307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 09:53:42.107307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 09:53:42.108173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:42.109406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 519/1037] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:42 2022] GET /identity/v3/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:42.114803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e713016-a540-423b-868c-b9b2125df13a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:42.123869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e713016-a540-423b-868c-b9b2125df13a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:42.127868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:42.128645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.128928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.129207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] PATH_INFO: `/v3/users/48013c3fc27949a3a8e606712614aad5` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.130316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] RBAC: Authorizing `identity:get_user(user_id=48013c3fc27949a3a8e606712614aad5)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:42.155822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:42.157238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 519/1038] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:42 2022] GET /identity/v3/users/48013c3fc27949a3a8e606712614aad5 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:42.162597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:42.172296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba946-d734-40fe-bb11-28882f43d568 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:42.176444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:42.177201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.177489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.177774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.178873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:42.204739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe7604-61e2-41c8-a4bd-01196db09d37 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:42.206257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 520/1039] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:42 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:42.211804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:42.220768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2579c-ece1-4866-9b11-e40ec4342ca2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:42.224794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:42.225582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:42.225871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:42.226224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b/users/48013c3fc27949a3a8e606712614aad5/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:42.228846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20846fe3d47240a4b10b2d8af0ced17b, user_id=48013c3fc27949a3a8e606712614aad5, role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:42.255471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515836d9-4ab3-4143-b390-37db04d6ec3e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:42.345560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 520/1040] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:53:42 2022] PUT /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b/users/48013c3fc27949a3a8e606712614aad5/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 09:53:44.282994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fb2-a27f-42bc-90e8-29dd9f0f0e92 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.283510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fb2-a27f-42bc-90e8-29dd9f0f0e92 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.283603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fb2-a27f-42bc-90e8-29dd9f0f0e92 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.285215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 521/1041] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:44.290306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.290751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.290952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.313156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:44.314317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:44.378171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 521/1042] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:44.400705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b8fb2-a27f-42bc-90e8-29dd9f0f0e92 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:44.412247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b8fb2-a27f-42bc-90e8-29dd9f0f0e92 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:44.416889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:44.417647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.417953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.418244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] PATH_INFO: `/v3/roles/1f2715a7d6044fccae1e0ac6160f269d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.419576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] RBAC: Authorizing `identity:get_role(role_id=1f2715a7d6044fccae1e0ac6160f269d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:44.444438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:44.445673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 522/1043] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:44 2022] GET /identity/v3/roles/1f2715a7d6044fccae1e0ac6160f269d => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:44.451184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:44.459612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14438-60f7-4edc-af87-e313d7190fab None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:44.464346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:44.465127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.465411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.465689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] PATH_INFO: `/v3/users/48013c3fc27949a3a8e606712614aad5` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.466809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] RBAC: Authorizing `identity:get_user(user_id=48013c3fc27949a3a8e606712614aad5)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:44.492662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:44.494292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 522/1044] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:44 2022] GET /identity/v3/users/48013c3fc27949a3a8e606712614aad5 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:44.499664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:44.508682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b967f2-00c7-4de8-a830-bf12ad0eb244 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:44.513299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:44.513854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.514179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.514458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.521816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:44.547074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:44.555250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 523/1045] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:44 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:44.560731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:44.569919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425fc98-206e-4eb6-a057-8bd07491c687 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:44.574962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:44.575716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.576001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.576281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.577359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:44.603334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82338239-f09c-40fd-a1c1-39803df17241 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:44.604813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 523/1046] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:44 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:44.610560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:44.619458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a744cd-8db7-4987-9993-7dd993054887 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:44.623625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:44.624189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:44.624477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:44.624760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:44.625526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] RBAC: Adding query filter params (role.id=1f2715a7d6044fccae1e0ac6160f269d, scope.project.id=20846fe3d47240a4b10b2d8af0ced17b, user.id=48013c3fc27949a3a8e606712614aad5) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:44.625833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:44.651041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810c1e8-7739-4451-9853-07336946f2d4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:44.656584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 524/1047] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:44 2022] GET /identity/v3/role_assignments?user.id=48013c3fc27949a3a8e606712614aad5&scope.project.id=20846fe3d47240a4b10b2d8af0ced17b&role.id=1f2715a7d6044fccae1e0ac6160f269d => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:46.642216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15abc90-7908-467d-855f-4a2cddd8d3df None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:46.642770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15abc90-7908-467d-855f-4a2cddd8d3df None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:46.642770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15abc90-7908-467d-855f-4a2cddd8d3df None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:46.644436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 524/1048] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:46.649441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:46.650416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:46.650609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:46.673158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:46.674315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:46.681055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 525/1049] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:46.703676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15abc90-7908-467d-855f-4a2cddd8d3df None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:46.715770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15abc90-7908-467d-855f-4a2cddd8d3df None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:46.719650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:46.720376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:46.720663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:46.720939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:46.722018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:46.747314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e5b82-19b5-417c-96ed-47dd43652290 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:46.748741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 525/1050] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:46.754177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:46.763303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b578e-381c-4e07-b6b1-f55841db5d56 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:46.767411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:46.767988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:46.768278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:46.768588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:46.769234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:46.794963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb651-5cbd-4932-90a9-70c2ae61cad4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:46.878542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 526/1051] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:53:46 2022] POST /identity/v3/projects => generated 311 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:53:48.866944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210f0a-9e4a-440c-87a4-e3c5659cb51d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:48.867501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210f0a-9e4a-440c-87a4-e3c5659cb51d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:48.867501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be210f0a-9e4a-440c-87a4-e3c5659cb51d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:48.869681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 526/1052] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:48.874738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:48.875145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:48.875315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:48.897318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:48.898479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:48.962940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 527/1053] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:48.986909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be210f0a-9e4a-440c-87a4-e3c5659cb51d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:48.999426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be210f0a-9e4a-440c-87a4-e3c5659cb51d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:49.003571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:49.004279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:49.004561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:49.004835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:49.005897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:49.030970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330de71c-5b00-4f58-b203-9d75aef48864 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:49.032407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 527/1054] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 09:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:49.037949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:49.046882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576c8ac-9d7e-4a40-b43e-26e81bdf6ddf None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:49.050934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:49.051538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:49.051821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:49.052095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:49.052748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:49.078475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a8dee-f52c-4f35-ae83-655c9ff240c7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:49.174509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 528/1055] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:53:49 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:53:51.206278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207be1-5d77-40f3-919a-2318a02577ee None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.206833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207be1-5d77-40f3-919a-2318a02577ee None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.206833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207be1-5d77-40f3-919a-2318a02577ee None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.208483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 528/1056] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 09:53:51.214303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.214724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.214858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.237832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:51.238915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:51.245764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 529/1057] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:51.268365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9207be1-5d77-40f3-919a-2318a02577ee None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.280720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9207be1-5d77-40f3-919a-2318a02577ee None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.284776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.285480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.285768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.286079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.298039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:51.304248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:51.305320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 529/1058] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:51.311283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.319837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc8ba3-62db-4b38-835b-86bd3d20cfc8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.324435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.325015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.325295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.325567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.326303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:51.326595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:51.352122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:51.360854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 530/1059] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 09:53:51.366534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.376133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d169df-dc86-4c66-ae0d-9b0c6f0a6549 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.380148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.380921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.381203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.381480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] PATH_INFO: `/v3/users/8570d44dd6234af7b66de40219c0d4ca` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.401165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8570d44dd6234af7b66de40219c0d4ca)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:51.426996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:51.428470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 530/1060] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/users/8570d44dd6234af7b66de40219c0d4ca => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:51.434117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.443500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50847c8-884e-4a4e-a962-9a618901169f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.448199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.448762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.449046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.449322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.456717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:51.482607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:51.493372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 531/1061] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:51.496829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.506219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784d80-386e-43ba-8990-0f27ff5a09c8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.511012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.511782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.512069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.512444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] PATH_INFO: `/v3/projects/b4d50fa983ee42b5a948a684ea509690` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.513582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4d50fa983ee42b5a948a684ea509690)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:51.539513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397692b-06a5-483c-9f1b-008abfa68922 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:51.541303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 531/1062] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/projects/b4d50fa983ee42b5a948a684ea509690 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:51.547041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:51.555611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046fe6-0fda-42e4-9c21-a40f31aad5bc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:51.559927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:51.560493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:51.560784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:51.561067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:51.561840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=b4d50fa983ee42b5a948a684ea509690, user.id=8570d44dd6234af7b66de40219c0d4ca) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:51.562173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:51.588402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2161e-c71a-4313-8c1c-34f562082735 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:51.593611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 532/1063] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:51 2022] GET /identity/v3/role_assignments?user.id=8570d44dd6234af7b66de40219c0d4ca&scope.project.id=b4d50fa983ee42b5a948a684ea509690&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:53.578933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637388-f00e-4af2-88d2-4671934bb0fd None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.579451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637388-f00e-4af2-88d2-4671934bb0fd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.579568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637388-f00e-4af2-88d2-4671934bb0fd None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.581148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 532/1064] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:53.586435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.586845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.586995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.609179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:53.610311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:53.616897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 533/1065] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:53.638678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637388-f00e-4af2-88d2-4671934bb0fd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:53.650459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637388-f00e-4af2-88d2-4671934bb0fd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:53.654364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:53.655064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.655364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.655645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.667231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:53.673372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:53.674455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 533/1066] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:53.680006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:53.689057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f93dc2-62a6-4969-9908-cb03fb80c7d1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:53.693373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:53.693980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.694273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.694555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.695260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:53.695560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:53.721522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:53.730400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 534/1067] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:53.736067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:53.746581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ca8f-8131-4fb6-adbe-774b8f7f676f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:53.750590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:53.751350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.751633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.751911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] PATH_INFO: `/v3/users/8570d44dd6234af7b66de40219c0d4ca` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.752981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8570d44dd6234af7b66de40219c0d4ca)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:53.778603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:53.780059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 534/1068] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:53 2022] GET /identity/v3/users/8570d44dd6234af7b66de40219c0d4ca => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:53.785302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:53.794869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0474f2b-cadd-43d7-9e2c-4fc88fe9104d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:53.798959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:53.799727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.800017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.800300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] PATH_INFO: `/v3/projects/b4d50fa983ee42b5a948a684ea509690` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.801373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4d50fa983ee42b5a948a684ea509690)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:53.827507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac524-9578-48b9-8863-d7f4226df571 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:53.829267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 535/1069] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:53 2022] GET /identity/v3/projects/b4d50fa983ee42b5a948a684ea509690 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:53.835198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:53.845742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e4cee-ab65-495d-ae9a-171ce25977e3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:53.850530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:53.851330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:53.851641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:53.851920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] PATH_INFO: `/v3/projects/b4d50fa983ee42b5a948a684ea509690/users/8570d44dd6234af7b66de40219c0d4ca/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:53.854741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d50fa983ee42b5a948a684ea509690, user_id=8570d44dd6234af7b66de40219c0d4ca, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:53.881336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c549d-a398-45e4-b6af-1942c88bf383 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:53.957568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 535/1070] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:53:53 2022] PUT /identity/v3/projects/b4d50fa983ee42b5a948a684ea509690/users/8570d44dd6234af7b66de40219c0d4ca/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:53:55.910662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c2ec-4968-4fd3-8d91-0c6c9d857d14 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:55.911224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c2ec-4968-4fd3-8d91-0c6c9d857d14 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:55.911224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c2ec-4968-4fd3-8d91-0c6c9d857d14 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:55.912909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 536/1071] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:55.918509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:55.918925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:55.919074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:55.941731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:55.942911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:56.005272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 536/1072] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:53:56.027684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672c2ec-4968-4fd3-8d91-0c6c9d857d14 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.039202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672c2ec-4968-4fd3-8d91-0c6c9d857d14 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.043671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.044375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.044663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.044943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.057553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:53:56.063871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:53:56.065192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 537/1073] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:53:56.070871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.087761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a587bf4-0bec-4282-939d-7253882ae4ea None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.091389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.092570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.092570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.092570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.093230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:56.093523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:56.130210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:56.139120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 537/1074] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:56.144963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.154717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167330d-c32c-473b-997c-9c25641bd762 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.158845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.159629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.159918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.160201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] PATH_INFO: `/v3/users/8570d44dd6234af7b66de40219c0d4ca` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.161331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8570d44dd6234af7b66de40219c0d4ca)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:56.187194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:56.188630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 538/1075] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/users/8570d44dd6234af7b66de40219c0d4ca => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:56.194328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.203529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529a72-5c37-4e7b-aa06-a4662d53a166 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.207588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.208150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.208440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.208720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.216750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:56.243236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:56.252141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 538/1076] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:56.258102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.267511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34b9ca-9618-4826-b0e2-a582689053a4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.271612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.272383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.272667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.272978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] PATH_INFO: `/v3/projects/b4d50fa983ee42b5a948a684ea509690` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.274091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4d50fa983ee42b5a948a684ea509690)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:56.300640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3ad41-98a8-4a7d-9b76-8e41ad6f0595 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:56.302203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 539/1077] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/projects/b4d50fa983ee42b5a948a684ea509690 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:56.307995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:56.316568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c612b-c9c7-4be4-973d-995eb981dece admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:56.320684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:56.321285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:56.321744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:56.322063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:56.322839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=b4d50fa983ee42b5a948a684ea509690, user.id=8570d44dd6234af7b66de40219c0d4ca) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:56.323141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:56.349302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd26d9-9f78-44f2-b906-00cbb5bc16a3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:56.356016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 539/1078] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:53:56 2022] GET /identity/v3/role_assignments?user.id=8570d44dd6234af7b66de40219c0d4ca&scope.project.id=b4d50fa983ee42b5a948a684ea509690&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:53:58.342972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cea3b-7ff5-4023-a5ee-22e2917a4a73 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:58.343526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cea3b-7ff5-4023-a5ee-22e2917a4a73 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:58.343526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cea3b-7ff5-4023-a5ee-22e2917a4a73 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:58.345186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 540/1079] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:53:58.350361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:58.350789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:58.350933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:58.374256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:53:58.375373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:53:58.382091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 540/1080] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:53:58 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:53:58.404206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cea3b-7ff5-4023-a5ee-22e2917a4a73 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:58.415602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cea3b-7ff5-4023-a5ee-22e2917a4a73 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:58.419464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:58.420020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:58.420301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:58.420578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:58.427854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:58.454565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:58.463061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 541/1081] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:53:58 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:53:58.468846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:58.477209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741fbc4-944a-4f92-a236-e97001070ee0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:58.481349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:58.482092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:58.482382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:58.482663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:58.490488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:58.516857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:58.531103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-8d81a7d3-2c13-46b8-a126-d25b6d3b9abc admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 06 09:53:58.532148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 541/1082] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 09:53:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 09:53:58.537719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:53:58.546471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487a48a-5f62-4ded-acb3-6316f548600c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:53:58.550490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:53:58.551056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:53:58.551338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:53:58.551613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:53:58.552283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:53:58.552576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:53:58.579423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd69228-e8ab-4ca4-ac13-6192d95201b6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:53:58.587549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 542/1083] 10.222.0.11 () {56 vars in 1136 bytes} [Wed Apr 6 09:53:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:00.542780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6118f3-4d9b-472c-aa8b-54e5ea41b588 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:00.543332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6118f3-4d9b-472c-aa8b-54e5ea41b588 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:00.543332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6118f3-4d9b-472c-aa8b-54e5ea41b588 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:00.545005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 542/1084] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:00.550066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558da4b-c7d7-4bbd-8383-24470a2aee32 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:00.550496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558da4b-c7d7-4bbd-8383-24470a2aee32 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:00.550635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558da4b-c7d7-4bbd-8383-24470a2aee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:00.573239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2558da4b-c7d7-4bbd-8383-24470a2aee32 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:00.574381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2558da4b-c7d7-4bbd-8383-24470a2aee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:00.581138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 543/1085] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:54:00.603269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6118f3-4d9b-472c-aa8b-54e5ea41b588 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:00.614705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6118f3-4d9b-472c-aa8b-54e5ea41b588 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:00.619181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:00.619747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:00.620035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:00.620315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:00.620997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:00.645917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 09:54:00.645917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 09:54:00.645917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 09:54:00.646809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386c303-1f78-489a-8199-89bcf39686b3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:00.702097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 543/1086] 10.222.0.11 () {60 vars in 1159 bytes} [Wed Apr 6 09:54:00 2022] POST /identity/v3/domains => generated 267 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 09:54:02.682913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86501-9a25-4dd8-b506-1c32dbc9b8d4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:02.683469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86501-9a25-4dd8-b506-1c32dbc9b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:02.683469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86501-9a25-4dd8-b506-1c32dbc9b8d4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:02.685141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 544/1087] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:02.690566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:02.690954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:02.691128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:02.714381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:02.715492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:02.778497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 544/1088] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:54:02.800338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc86501-9a25-4dd8-b506-1c32dbc9b8d4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:02.811768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc86501-9a25-4dd8-b506-1c32dbc9b8d4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:02.815904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:02.816665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:02.816946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:02.817219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] PATH_INFO: `/v3/domains/a610bb5ade1247f5af4ff600ad65737d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:02.829457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a610bb5ade1247f5af4ff600ad65737d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:02.854990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a9a22-43e2-4b7f-864f-a7b1f129c816 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:02.856428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 545/1089] 10.222.0.11 () {56 vars in 1204 bytes} [Wed Apr 6 09:54:02 2022] GET /identity/v3/domains/a610bb5ade1247f5af4ff600ad65737d => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:02.862056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:02.871146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367faef-f99f-413a-8f4b-deb3454a684a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:02.875254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:02.875835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:02.876123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:02.876404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:02.877057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:02.902737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c8fa-930a-43e3-9d4a-01ed4aa588e7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:02.994127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 545/1090] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 09:54:02 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:54:04.994957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23136064-03aa-49ba-8eec-9f1c276c593a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:04.995364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23136064-03aa-49ba-8eec-9f1c276c593a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:04.995531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23136064-03aa-49ba-8eec-9f1c276c593a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:04.997214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 546/1091] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:05.002266 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:05.002667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:05.002837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:05.024240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:05.025404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:05.086277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 546/1092] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:54:05.109833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23136064-03aa-49ba-8eec-9f1c276c593a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:05.121424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23136064-03aa-49ba-8eec-9f1c276c593a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:05.125427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:05.126222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:05.126515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:05.126798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] PATH_INFO: `/v3/domains/a610bb5ade1247f5af4ff600ad65737d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:05.127856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a610bb5ade1247f5af4ff600ad65737d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:05.153825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f008a-f787-4c0f-9850-697b71d97f5c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:05.155284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 547/1093] 10.222.0.11 () {56 vars in 1204 bytes} [Wed Apr 6 09:54:05 2022] GET /identity/v3/domains/a610bb5ade1247f5af4ff600ad65737d => generated 267 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:05.160600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:05.169006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6325-4f3d-4a6f-b8d7-5b7585c2f24e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:05.173725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:05.174345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:05.174627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:05.174908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:05.175560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:05.201951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f5fc3-6cc7-4b00-81a9-e1f6b3ea2795 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:05.306737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 547/1094] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 09:54:05 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 09:54:07.302992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f21f-21f4-4203-8748-deb6396d8795 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.303527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f21f-21f4-4203-8748-deb6396d8795 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.303629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69f21f-21f4-4203-8748-deb6396d8795 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.305293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 548/1095] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:07.311111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.311503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.311668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.333942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:07.335073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:07.342381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 548/1096] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:54:07.365118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69f21f-21f4-4203-8748-deb6396d8795 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.377175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69f21f-21f4-4203-8748-deb6396d8795 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.381107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.381805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.382122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.382407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.393400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:54:07.400477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:54:07.401533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 549/1097] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:54:07.407050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.416420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c337b4-73e8-4a1f-a143-a19c037c9844 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.420504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.421084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.421375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.421753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.422500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:54:07.422800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:07.448869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:07.457625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 549/1098] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:07.464109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.474276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea06a-0e28-43aa-b039-c67f63ed2ac1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.479057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.479839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.480129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.480412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] PATH_INFO: `/v3/users/251546c97f4541bda763d1ee84dc4edf` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.498049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] RBAC: Authorizing `identity:get_user(user_id=251546c97f4541bda763d1ee84dc4edf)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:07.523266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:07.525459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 550/1099] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/users/251546c97f4541bda763d1ee84dc4edf => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:07.531293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.540999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf49-d60f-4b13-8d9f-0b34518c60df admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.545098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.545661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.545978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.546272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.553687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:07.579000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:07.587773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 550/1100] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:54:07.593445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.603096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00a142-1b84-4d6f-98d8-b0c281efba25 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.607318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.608087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.608375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.608656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] PATH_INFO: `/v3/projects/3aa39309e982455fa4b149aac03c5e3d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.609725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3aa39309e982455fa4b149aac03c5e3d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:07.635048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac579f-5933-4116-9c19-c1cea6db5cd7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:07.636530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 551/1101] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/projects/3aa39309e982455fa4b149aac03c5e3d => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:07.642118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:07.650848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d8f9-9cb2-455f-bfa7-4c5be15eb60b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:07.655008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:07.655567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:07.655855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:07.656136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:07.656902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=3aa39309e982455fa4b149aac03c5e3d, user.id=251546c97f4541bda763d1ee84dc4edf) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:54:07.657204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:07.682820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581466f-ef42-4cca-b3af-4a3e8a33e126 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:07.687956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 551/1102] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:54:07 2022] GET /identity/v3/role_assignments?user.id=251546c97f4541bda763d1ee84dc4edf&scope.project.id=3aa39309e982455fa4b149aac03c5e3d&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:09.619310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c305-01b9-4ea0-bf53-b3f7b1d5ce2f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.619861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c305-01b9-4ea0-bf53-b3f7b1d5ce2f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.619861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78c305-01b9-4ea0-bf53-b3f7b1d5ce2f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.621528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 552/1103] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:09.626657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.627103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.627212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.649608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:09.650751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:09.657407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 552/1104] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 09:54:09.679135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c305-01b9-4ea0-bf53-b3f7b1d5ce2f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:09.690953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78c305-01b9-4ea0-bf53-b3f7b1d5ce2f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:09.694952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:09.695645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.695983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.696242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.707156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:54:09.714388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:54:09.715436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 553/1105] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:54:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:54:09.720976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:09.730019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48907-ba56-4279-867b-9e6552ae0955 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:09.734049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:09.734627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.734908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.735183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.735884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:54:09.736179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:09.761173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:09.769415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 553/1106] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:09.775341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:09.785251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5361029-0d95-4106-bb7b-4884828440b3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:09.789408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:09.791111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.791395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.791672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] PATH_INFO: `/v3/users/251546c97f4541bda763d1ee84dc4edf` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.792763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] RBAC: Authorizing `identity:get_user(user_id=251546c97f4541bda763d1ee84dc4edf)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:09.818209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:09.819626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 554/1107] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:54:09 2022] GET /identity/v3/users/251546c97f4541bda763d1ee84dc4edf => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:09.826552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:09.835574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd005-cc88-40be-800d-4e9a50483be9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:09.840738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:09.847711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.847711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.847711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] PATH_INFO: `/v3/projects/3aa39309e982455fa4b149aac03c5e3d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.847711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3aa39309e982455fa4b149aac03c5e3d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:09.870594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33135681-4b3c-44ab-b715-b6f6ec81a8f1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:09.873646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 554/1108] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:54:09 2022] GET /identity/v3/projects/3aa39309e982455fa4b149aac03c5e3d => generated 361 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:09.879559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:09.888922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3d375-9b06-40c2-9e08-c69c14c03ea3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:09.910431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:09.911230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:09.911513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:09.911789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] PATH_INFO: `/v3/projects/3aa39309e982455fa4b149aac03c5e3d/users/251546c97f4541bda763d1ee84dc4edf/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:09.914362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa39309e982455fa4b149aac03c5e3d, user_id=251546c97f4541bda763d1ee84dc4edf, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:09.941298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd33e1-54dc-4d1a-b215-488807833141 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:10.031892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 555/1109] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 09:54:09 2022] PUT /identity/v3/projects/3aa39309e982455fa4b149aac03c5e3d/users/251546c97f4541bda763d1ee84dc4edf/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 09:54:11.975013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e8ab-651c-4fb9-99d3-53c9beb09a8a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:11.975535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e8ab-651c-4fb9-99d3-53c9beb09a8a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:11.975653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58e8ab-651c-4fb9-99d3-53c9beb09a8a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:11.978035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 555/1110] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 09:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 09:54:11.983225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:11.983627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:11.983798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.006136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 09:54:12.007258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 09:54:12.070635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 556/1111] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 09:54:11 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 09:54:12.093166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e8ab-651c-4fb9-99d3-53c9beb09a8a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.105470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58e8ab-651c-4fb9-99d3-53c9beb09a8a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.109388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.110128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.110420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.110701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.122658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 09:54:12.129004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 09:54:12.130120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 556/1112] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 09:54:12.136467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.146855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5b5d7-0ae0-4368-ac8c-861faa67991c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.151519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.152108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.152392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.152670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.153374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:54:12.153667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:12.178825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:12.187567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 557/1113] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:12.193634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.202992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28bbf-f131-42d4-a762-5e865c26d498 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.207132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.207914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.208205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.208488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] PATH_INFO: `/v3/users/251546c97f4541bda763d1ee84dc4edf` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.209582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] RBAC: Authorizing `identity:get_user(user_id=251546c97f4541bda763d1ee84dc4edf)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:12.236161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:12.237552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 557/1114] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/users/251546c97f4541bda763d1ee84dc4edf => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:12.243071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.251977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a75ce-89a1-4adf-856f-af655ba5ae94 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.255981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.256536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.256818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.257096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.264953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:12.290139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:12.298446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 558/1115] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 09:54:12.304025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.313704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3256ad4-0b18-4ff3-9078-c799ecdacd93 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.318172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.318925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.319240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.319520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] PATH_INFO: `/v3/projects/3aa39309e982455fa4b149aac03c5e3d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.320601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3aa39309e982455fa4b149aac03c5e3d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:12.345872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce111ec-0711-432c-a22c-313c20c6c5e5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:12.347399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 558/1116] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/projects/3aa39309e982455fa4b149aac03c5e3d => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 09:54:12.353337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 09:54:12.361548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7dc59-b38e-4b57-90c6-1fb6725e92ea admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 09:54:12.365604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 09:54:12.366189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 09:54:12.366472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 09:54:12.366747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 09:54:12.367497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=3aa39309e982455fa4b149aac03c5e3d, user.id=251546c97f4541bda763d1ee84dc4edf) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 09:54:12.368381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 09:54:12.393555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20509d52-59b3-4707-a3a1-101e45b5959c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 09:54:12.399759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 559/1117] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 09:54:12 2022] GET /identity/v3/role_assignments?user.id=251546c97f4541bda763d1ee84dc4edf&scope.project.id=3aa39309e982455fa4b149aac03c5e3d&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:22.729369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920c2b-d72b-4c44-9550-4a76695c1180 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:22.730540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920c2b-d72b-4c44-9550-4a76695c1180 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:22.730540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920c2b-d72b-4c44-9550-4a76695c1180 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:22.732191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 559/1118] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:22.737204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:22.737618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:22.737769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:22.825485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:22.826634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:22.867978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 560/1119] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:22.891636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920c2b-d72b-4c44-9550-4a76695c1180 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:22.905814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920c2b-d72b-4c44-9550-4a76695c1180 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:22.909770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:22.910508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:22.910794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:22.911071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:22.924716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:22.952742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:22.970741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:22.971884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 560/1120] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:22.977946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:22.987604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf71ce1-eb3f-46cc-a864-69c232f3aa20 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:22.991966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:22.996351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:22.996351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:22.996351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:22.996351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:22.996351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:23.019923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca16c9-2cfa-492c-a10d-f3fe751ab752 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:23.033584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 561/1121] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:23.039235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:23.049126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc202-6378-4359-a652-8882b7a55cc7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:23.053549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:23.056866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:23.056866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:23.056866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:23.056866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:23.080810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027d8e2-f90a-4842-b2ef-98895a69378a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:23.209588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 561/1122] 10.222.0.11 () {60 vars in 1153 bytes} [Wed Apr 6 10:00:23 2022] POST /identity/v3/users => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:00:25.248439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea6ed-80ad-4c2a-ab28-46bfc9fdb28f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.248946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea6ed-80ad-4c2a-ab28-46bfc9fdb28f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.248946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea6ed-80ad-4c2a-ab28-46bfc9fdb28f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.250710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 562/1123] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:25.255968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.256369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.256543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.278623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:25.279744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:25.286613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 562/1124] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:25 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:00:25.309958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea6ed-80ad-4c2a-ab28-46bfc9fdb28f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.321287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea6ed-80ad-4c2a-ab28-46bfc9fdb28f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.326214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.326520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.326805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.327081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.337898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:25.344320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:00:25.345374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 563/1125] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:25.351217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.360036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52054-0928-4cf2-8e41-4999166e4dc8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.364090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.364675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.364965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.365248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.365982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:25.366285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.392820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.400944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 563/1126] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:25.406544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.415972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5084-38e2-4725-9259-d34b1a0da00d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.420065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.420749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.421033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.421311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.432378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.458709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.475673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:25.476695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 564/1127] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:25.482639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.491569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53706fcc-9292-4f50-a84d-83f3f98a1dab admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.496230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.496803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.497087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.497369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.498075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:25.498379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.523370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.535698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 564/1128] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:25.541043 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.550587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f2eb-b3a5-4b70-9aca-dbe00e904258 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.554880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.555577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.555862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.556138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.569112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.594201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.611792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:25.612823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 565/1129] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:25.618396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.627945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ed8d0-b454-4e90-a159-5b99dc5dad57 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.632028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.632607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.632893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.633174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.633990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:25.634295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.659308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.689945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 565/1130] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:25.695408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.704447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5c26-86e5-4bdf-b00e-e9ae479d77de admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.708415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.708969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.709252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.709527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.717018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.742183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.751898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 566/1131] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:00:25.757408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.766511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a522-99b7-4690-a7b0-5a95daf727e7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.770600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.771301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.771588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.771869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.783186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.809145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.826096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:25.827140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 566/1132] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:25.832481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.841256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8ba4-32e3-46aa-b68d-af9d92a02625 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.845309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.845924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.846252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.846528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.847206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:25.847500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.872835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.886636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 567/1133] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:25.892070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.900983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194509-dee8-4f41-bd71-52b31fcdc90d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.905144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.905834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.906151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.906432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.914998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:25.940938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:25.954837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:25.955896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 567/1134] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:25.961476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:25.970624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ac3d0-d431-4652-9138-808de9c06f87 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:25.974737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:25.975312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:25.975598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:25.975875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:25.976611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:25.976910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:26.002564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e099ccc-bb36-4f82-9271-3a61a7f38bca admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:26.016028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 568/1135] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:26.021786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:26.030981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e2a8-aa94-4128-8b14-44a0afb7b464 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:26.035025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:26.035537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:26.035822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:26.036100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:26.036864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=99c2c40c6d154576af32478a958db15e) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:26.037161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:26.063166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13d1e-390a-4a9e-825d-48e4df4f09bb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:26.068277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 568/1136] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 10:00:26 2022] GET /identity/v3/role_assignments?user.id=99c2c40c6d154576af32478a958db15e&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:28.014865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea037f7-c84d-4381-8763-478074d56951 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.015363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea037f7-c84d-4381-8763-478074d56951 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.015477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea037f7-c84d-4381-8763-478074d56951 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.017143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 569/1137] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:28.022197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.022604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.022770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.045232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:28.046388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:28.053601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 569/1138] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:28.075489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea037f7-c84d-4381-8763-478074d56951 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.087010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea037f7-c84d-4381-8763-478074d56951 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.091126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.091835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.092122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.092404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.103353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:28.110517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:00:28.111571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 570/1139] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:28.117106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.126893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652fa4b-50e2-4c78-8d94-35a594c0b5d7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.130971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.131555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.131842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.132122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.132829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:28.133127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.158971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.167783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 570/1140] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:28.173438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.183516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6c4c-770f-4b92-8635-4e0ac9fe999f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.187635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.188334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.188621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.188903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.201253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.228298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.246832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:28.247927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 571/1141] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:28.253796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.263290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415838e-781c-460e-87f1-e8537247a7ea admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.267400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.267984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.268270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.268548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.269230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:28.269525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.296456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.309302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 571/1142] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:00:28.314795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.324054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ed8-26fe-4ff9-87d0-5782bcf02259 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.328142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.328848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.329132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.329409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.342990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.368913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.386669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:28.387727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 572/1143] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:28.393454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.403694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9906-b13e-429f-b466-03611cf758bd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.407848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.408424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.408707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.408986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.409763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:28.410090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.436837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.467492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 572/1144] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:28.473223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.483248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c0f32-15ea-4d20-8e63-82bed9bcc155 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.487311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.488013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.488298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.488578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.500751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.526356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.543560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:28.544615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 573/1145] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:28.550475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.560214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344712d-b522-4b79-b858-3ac7bda805c7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.564307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.566750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.566750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.566750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.566750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:28.566750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.593159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.605866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 573/1146] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:28.611369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.620818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4252-5da0-4b45-94ae-b7db8d3b5bb2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.624869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.627309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.627309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.627309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.634766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.661716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.675295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:28.676336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 574/1147] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:28.682341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.691630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6bad8-1994-436b-9ae8-d6382561efcb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.695795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.696367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.696652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.696932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.697663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:28.697989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.724034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176054-9469-4685-a26d-3fa19390021c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.737361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 574/1148] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:28.742993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:28.753326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d913c1-c116-4bda-93ae-d377e4826b24 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:28.757408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:28.758237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:28.758522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:28.758800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/99c2c40c6d154576af32478a958db15e/roles/c5ab969b019c472582c2474221f4fbe0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:28.795994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=99c2c40c6d154576af32478a958db15e, role_id=c5ab969b019c472582c2474221f4fbe0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:28.822696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e4de5-ea1c-4fcb-8d53-c2d596b08472 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:28.922556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 575/1149] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 10:00:28 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/99c2c40c6d154576af32478a958db15e/roles/c5ab969b019c472582c2474221f4fbe0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:00:30.898631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f88cc-39bf-4f84-ab9d-9a1d5f80c055 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:30.899181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f88cc-39bf-4f84-ab9d-9a1d5f80c055 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:30.899181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f88cc-39bf-4f84-ab9d-9a1d5f80c055 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:30.900853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 575/1150] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:30.906936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:30.907355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:30.907500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:30.929597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:30.930751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:30.992932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 576/1151] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:31.016432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f88cc-39bf-4f84-ab9d-9a1d5f80c055 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.028347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f88cc-39bf-4f84-ab9d-9a1d5f80c055 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.032249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.032953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.033237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.033513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.045150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:31.051512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 10:00:31.052647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 576/1152] 10.222.0.11 () {56 vars in 1123 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:00:31.059268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.067621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c353d01-3e64-4d67-9427-d17c901c1506 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.071687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.072266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.072553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.072832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.073541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.073839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.099229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.108124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 577/1153] 10.222.0.11 () {56 vars in 1124 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:31.113549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.123380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abad46-dae9-474f-bd73-2f40caad65e2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.127417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.128105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.128386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.128662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.139456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.165164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.183268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:31.184452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 577/1154] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:31.190076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.199025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb4175-2fb2-4ed7-ad0b-7a9469018483 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.203296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.203869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.204159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.204440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.205121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.205419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.231243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.244701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 578/1155] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:31.250046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.258957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068bbf-352a-4349-b828-1f0102bae45e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.263020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.263719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.264148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.264270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.278779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.304701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.321797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:31.322852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 578/1156] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:31.328658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.337811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4f81-aea9-41ac-9286-0fb4d1af03e1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.342440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.343025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.343312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.343594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.344375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.344677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.370318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.398090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 579/1157] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:31.404353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.413446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aab99f-e311-4f8e-99bc-205215234011 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.417501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.418658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.418946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.419224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.426604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.452096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.461386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 579/1158] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:00:31.467454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.476473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff186b1-fb42-4d78-9aef-1b50274bed7b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.480663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.481368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.481658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.481951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.493193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.518785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.535861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:31.536910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 580/1159] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:31.542238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.550684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e378aa-fb51-435c-87cc-0bba9d54d515 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.555131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.555705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.555996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.556278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.556958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.557258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.582708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.595786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 580/1160] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:00:31.601245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.610413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddac16b-8d0e-4a30-99f0-02858434091c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.614529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.615225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.615513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.615794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.624698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.650338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.664243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:31.665275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 581/1161] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:31.671031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.680401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327162-9c06-4296-88cf-02bbede9ee69 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.684531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.685114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.685402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.685685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.686453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.686760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.712171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2b3ee-5752-4a7a-bd7b-0f15154f59ab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.725419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 581/1162] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:31.731246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:31.740578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc63bd7-a3d2-492d-a86b-16fed51452dd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:31.744691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:31.745254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:31.745542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:31.745823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:31.746764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] RBAC: Adding query filter params (role.id=c5ab969b019c472582c2474221f4fbe0, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=99c2c40c6d154576af32478a958db15e) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:31.747073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:31.772413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316055ae-545e-4cc0-b909-2b98b61ccbf8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:31.778653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 582/1163] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 10:00:31 2022] GET /identity/v3/role_assignments?user.id=99c2c40c6d154576af32478a958db15e&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=c5ab969b019c472582c2474221f4fbe0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:33.992111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1b109-3f9b-4d76-b442-de30bb5b399b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:33.992558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1b109-3f9b-4d76-b442-de30bb5b399b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:33.992675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1b109-3f9b-4d76-b442-de30bb5b399b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:33.994592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 582/1164] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:34.003781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.004241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.004331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.028808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:34.029984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:34.039066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 583/1165] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:00:34.067638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1b109-3f9b-4d76-b442-de30bb5b399b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.081068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1b109-3f9b-4d76-b442-de30bb5b399b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.085212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.085951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.086242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.086526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.098292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:34.104607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:00:34.106437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 583/1166] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:34.112548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.121049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cb07c-0c52-49f9-963e-e43f48f2d37b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.125166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.125752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.126076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.126358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.127061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.127359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.152789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.161562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 584/1167] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:34.167302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.177582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7b2e-f2b4-44e3-8817-26cc11bce22e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.182037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.182735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.183018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.189028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.194865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.220990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.239624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:34.240672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 584/1168] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:34.246609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.255875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7265f4-ccb4-4811-8b5f-3ffbcd3c2a24 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.260079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.260659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.260949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.261229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.261956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.262302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.287557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.301149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 585/1169] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:34.307167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.316767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7b08c-7d39-429f-aa75-61ee262e8d54 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.320816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.321527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.321812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.322122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.342144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.368259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.386031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:34.387275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 585/1170] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:34.392994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.403195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa66f55-b611-49a0-ab27-9a4ba24dc10d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.407378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.407973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.410266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.410266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.410266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.410266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.435642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.464394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 586/1171] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:34.470935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.480185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf81c-636a-4289-9c46-362237cb565f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.484790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.485360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.485647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.485925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.493368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.519737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.530031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 586/1172] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:00:34.536075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.545526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d42ce7-58f0-43d4-a865-bd97bf42499b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.549681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.550429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.550719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.551001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.562649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.587864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.604932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:34.606069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 587/1173] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:34.611763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.620271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622c69a-4508-4662-a358-38dcb60425f4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.624839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.626807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.626807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.626807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.626807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.627138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.653030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.665960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 587/1174] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:34.674065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.684068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c47cb0-9afd-4bc7-b866-b2087f691297 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.688496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.689199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.689479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.689753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.698629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.726282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.740609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:34.741741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 588/1175] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:34.747884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.757105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf062f7-4e51-4deb-8b91-bddca9f168cc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.761218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.762691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.762955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.763235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.763968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.764327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.790817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ecf5e-28a3-47be-9773-17c5d6875b6b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.804246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 588/1176] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:34.810131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:34.819257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd93eb-676c-4bf5-85c0-c7a64009a1b6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:34.823319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:34.823878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:34.824666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:34.824939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:34.825703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=99c2c40c6d154576af32478a958db15e) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:34.826031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:34.851377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0357c-74bf-412f-a107-f126310ed5ba admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:34.856557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 589/1177] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 10:00:34 2022] GET /identity/v3/role_assignments?user.id=99c2c40c6d154576af32478a958db15e&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:36.837019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997f99-bc33-4ea6-ad59-047fdf26bf51 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:36.837624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997f99-bc33-4ea6-ad59-047fdf26bf51 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:36.837624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997f99-bc33-4ea6-ad59-047fdf26bf51 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:36.839369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 589/1178] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:36.845037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:36.845478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:36.845611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:36.868470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:36.869605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:36.877216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 590/1179] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:36.899162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997f99-bc33-4ea6-ad59-047fdf26bf51 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:36.911617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997f99-bc33-4ea6-ad59-047fdf26bf51 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:36.917578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:36.919015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:36.921635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:36.922051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:36.934368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:36.940697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:00:36.942036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 590/1180] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 10:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:36.947918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:36.956718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f093-6858-46e3-8684-d13c2fc22424 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:36.960810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:36.961402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:36.961691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:36.962005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:36.962736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:36.963022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:36.988451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:36.997829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 591/1181] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 10:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:37.003574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.013704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef0b93-8c5b-46ec-8f86-96d26d53a931 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.017833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.018560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.018849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.019134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.030986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.056954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.074586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:37.075641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 591/1182] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:00:37.081130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.091222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a1d5d-e512-41aa-910f-d7cf9ae85f94 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.095229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.095822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.096109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.096387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.097071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:37.097367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.123299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.137242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 592/1183] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:37.142721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.151835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f23ce-5b45-47ab-9681-4104112f60b8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.156710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.157420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.157711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.158034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.172362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.197680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.215756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:37.216806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 592/1184] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:00:37.222457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.232456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969158c5-505f-4e7e-be38-1102ae207b35 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.236491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.237050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.237333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.237608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.238448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:37.238745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.264904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.296529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 593/1185] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:37.302437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.312325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf28b-09de-4515-ba80-c9e797799527 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.316467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.317169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.317457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.317735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.329714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.356147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.372471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:37.373530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 593/1186] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:37.379233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.388433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc778b0e-e3d3-481e-8f83-cc04d5bdd6d6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.392467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.393050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.393336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.393614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.394335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:37.394635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.420416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.433240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 594/1187] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:37.438883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.448149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ceab1-fe23-45c3-8226-460f59438cd3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.453556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.454368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.454658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.454936 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.464134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.492708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.506970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:37.508079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 594/1188] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:37.515189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.524524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f940a-de37-4596-9c73-a3fd3bf31efd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.529324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.529901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.530215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.530495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.531235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:37.531536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.556521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd03f-cacc-42ab-8c02-84f52e4e89e0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.570191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 595/1189] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:37.578015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:37.588795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb012c2-b5e8-4177-a4ef-e10f05a1a934 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:37.593642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:37.594479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:37.594770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:37.595054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] PATH_INFO: `/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/99c2c40c6d154576af32478a958db15e/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:37.596794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69513349c8d54d8faaa11d039cee2c63, user_id=99c2c40c6d154576af32478a958db15e, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:37.622989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d8e3-8be1-4df7-bab7-bc1e6f3c3193 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:37.686868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 595/1190] 10.222.0.11 () {58 vars in 1460 bytes} [Wed Apr 6 10:00:37 2022] PUT /identity/v3/projects/69513349c8d54d8faaa11d039cee2c63/users/99c2c40c6d154576af32478a958db15e/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:00:39.663103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bf8fb-f2c5-4524-a31c-814ab197457e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.663669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bf8fb-f2c5-4524-a31c-814ab197457e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.663669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bf8fb-f2c5-4524-a31c-814ab197457e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.665342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 596/1191] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:39.671172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.671603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.672923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.696598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:39.697723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:39.761188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 596/1192] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:39.785022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bf8fb-f2c5-4524-a31c-814ab197457e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:39.796976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bf8fb-f2c5-4524-a31c-814ab197457e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:39.800913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:39.801615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.801904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.802244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.813432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 06 10:00:39.819730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 10:00:39.820799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 597/1193] 10.222.0.11 () {56 vars in 1117 bytes} [Wed Apr 6 10:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:39.827120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:39.835411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2233a-1da2-4a3d-a322-92d4d15c1196 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:39.840038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:39.840615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.840899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.841176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.841876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:39.842199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:39.867269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:39.875756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 597/1194] 10.222.0.11 () {56 vars in 1120 bytes} [Wed Apr 6 10:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:39.881312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:39.891328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb16839-d8df-4c6e-89cc-72d386b413e5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:39.895460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:39.896150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.896440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.896718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.908253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:39.933785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:39.951397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:39.952463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 598/1195] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:39.958051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:39.967643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d16b-cc11-4289-bbae-76d031a501c1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:39.971831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:39.972403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:39.972690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:39.972966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:39.973640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:39.973970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:39.998812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.012144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 598/1196] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:00:40.017428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.026650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80253fdf-8a52-4e7f-a5ba-c839628ce820 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.031489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.032201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.032491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.032773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.045210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.070660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.088664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 10:00:40.090348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 599/1197] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:40.095781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.104791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26df9c-85b1-4a6b-a146-3a0db1559519 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.109181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.109759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.110072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.110353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.111131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:40.111428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.137681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.165260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 599/1198] 10.222.0.11 () {56 vars in 1164 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:00:40.170955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.180300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81472-a6e2-432b-82f9-0aa2b8b6bbcf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.184973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.185484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.185773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.186090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.193512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.218740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.227831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 600/1199] 10.222.0.11 () {58 vars in 1324 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:00:40.233762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.242790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71258-6199-4637-bb37-0789f529abd2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.247540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.248244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.248541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.248820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.265457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.291021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.307905 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 10:00:40.309625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 600/1200] 10.222.0.11 () {56 vars in 1129 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:40.315445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.324510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9014d-055f-40e7-9a1b-2dd95d4bd1cd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.328536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.329115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.329402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.329684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.330395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:40.330696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.355490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.367923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 601/1201] 10.222.0.11 () {56 vars in 1130 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:40.374407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.383328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d5a5-8fda-4dd1-ab72-3ec867c028aa admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.387898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.388586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.388869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.389145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.398109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.423313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.437287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING keystone.server.flask.application [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 10:00:40.438302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 601/1202] 10.222.0.11 () {56 vars in 1132 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 10:00:40.444101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.453904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6991a9-d408-4e0e-bb77-3556ede3b894 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.458177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.458750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.459038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.459317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.460050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:40.460350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.485959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45021e-e95f-4ffe-b03a-62c6e6d0b2cc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.502972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 602/1203] 10.222.0.11 () {56 vars in 1169 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:40.512568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:40.521911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118175b-277a-4fe5-8a0e-f43eec0ef3c5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:40.526000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:40.526608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:40.526945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:40.527708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:40.528493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] RBAC: Adding query filter params (role.id=2d75a104a2e84475b408c49f7034503e, scope.project.id=69513349c8d54d8faaa11d039cee2c63, user.id=99c2c40c6d154576af32478a958db15e) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:40.528834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:40.555651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dff85-2f00-4905-a439-407097b3690f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:40.562761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 602/1204] 10.222.0.11 () {56 vars in 1395 bytes} [Wed Apr 6 10:00:40 2022] GET /identity/v3/role_assignments?user.id=99c2c40c6d154576af32478a958db15e&scope.project.id=69513349c8d54d8faaa11d039cee2c63&role.id=2d75a104a2e84475b408c49f7034503e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:42.549994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a446be-30fd-4431-afcd-259a7d6f1b26 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:42.550555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a446be-30fd-4431-afcd-259a7d6f1b26 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:42.550555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a446be-30fd-4431-afcd-259a7d6f1b26 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:42.552229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 603/1205] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:42.557628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:42.558536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:42.558991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:42.581176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:42.582312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:42.588978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 603/1206] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:42 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:42.610097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a446be-30fd-4431-afcd-259a7d6f1b26 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:42.622196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a446be-30fd-4431-afcd-259a7d6f1b26 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:42.626145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:42.626857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:42.627141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:42.627418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:42.628039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:42.653334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:42.663596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:00:42.664629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 604/1207] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 10:00:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:42.670478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:42.679085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d180-f39a-4b3a-b068-bda305918376 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:42.683759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:42.684503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:42.684790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:42.685064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:42.685726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:42.686055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:42.711843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0cfa-ee09-445a-acd7-46880fcd9b54 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:42.716795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 604/1208] 10.222.0.11 () {56 vars in 1137 bytes} [Wed Apr 6 10:00:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:42.722269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:42.731736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09839-6c40-48ed-a9d2-5a8aea4ddf9b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:42.735776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:42.736346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:42.736634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:42.736914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] PATH_INFO: `/v3/services` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:42.737575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:42.737871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:42.763342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51df3d3-7385-4a8b-947c-90b86e6d8002 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:42.767502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 605/1209] 10.222.0.11 () {56 vars in 1137 bytes} [Wed Apr 6 10:00:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:44.739301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38514-dc62-4180-a914-8bc520f937c2 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:44.739826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38514-dc62-4180-a914-8bc520f937c2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:44.739938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a38514-dc62-4180-a914-8bc520f937c2 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:44.741526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 605/1210] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:44.747094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489bfc-1304-4e6a-ba27-7c214567d5c9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:44.747511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489bfc-1304-4e6a-ba27-7c214567d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:44.747647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12489bfc-1304-4e6a-ba27-7c214567d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:44.770004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-12489bfc-1304-4e6a-ba27-7c214567d5c9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:44.771122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-12489bfc-1304-4e6a-ba27-7c214567d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:44.778022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 606/1211] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:44 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:44.799943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a38514-dc62-4180-a914-8bc520f937c2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:44.812352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a38514-dc62-4180-a914-8bc520f937c2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:44.816312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:44.816886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:44.817173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:44.817451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:44.818147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:44.843868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747dc3f-cc02-4174-9ad2-5cf64565c667 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:44.936960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 606/1212] 10.222.0.11 () {60 vars in 1162 bytes} [Wed Apr 6 10:00:44 2022] POST /identity/v3/services => generated 246 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:00:46.916131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af566123-708a-452e-b30d-f353fee2d6e4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:46.916690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af566123-708a-452e-b30d-f353fee2d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:46.916690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af566123-708a-452e-b30d-f353fee2d6e4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:46.919088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 607/1213] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:46.924073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:46.924461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:46.924645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:46.948066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:46.949373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:46.966930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 607/1214] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:46.989080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af566123-708a-452e-b30d-f353fee2d6e4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:47.000788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af566123-708a-452e-b30d-f353fee2d6e4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:47.004781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:47.005492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:47.005782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:47.006100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:47.006725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:47.032307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:47.043280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:00:47.044316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 608/1215] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 10:00:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:47.050093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:47.058789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27a49-9092-4459-bf68-b998dbbf6bcc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:47.062838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:47.063416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:47.063702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:47.063982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:47.064652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:47.064949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:47.090367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:47.095327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 608/1216] 10.222.0.11 () {56 vars in 1137 bytes} [Wed Apr 6 10:00:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:47.100877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:47.110554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f041dcf-8e1b-4348-b79c-bffe46ee8e9b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:47.118135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:47.118135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:47.118135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:47.118135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:47.118482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] RBAC: Adding query filter params (interface=public, service_id=c887762c16e245d4aafb592a9febef9e, region_id=RegionOne) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:47.118482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:47.141467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c96a7-4f0d-428d-9e06-0e6d96bf7c1e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:47.146572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 609/1217] 10.222.0.11 () {56 vars in 1272 bytes} [Wed Apr 6 10:00:47 2022] GET /identity/v3/endpoints?service_id=c887762c16e245d4aafb592a9febef9e&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:47.152362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:47.161341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb489-374c-4b9e-a88d-a336064a52bd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:47.165392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:47.166000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:47.166342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:47.166576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:47.167854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:47.192671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6aa69-1ec6-4e65-bd76-4b4a20ef0cce admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:47.200052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 609/1218] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 10:00:47 2022] GET /identity/v3/services => generated 2430 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:00:49.157394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389895-02be-4afa-8589-0d3c8fd87ad9 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:49.157911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389895-02be-4afa-8589-0d3c8fd87ad9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:49.158058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52389895-02be-4afa-8589-0d3c8fd87ad9 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:49.159634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 610/1219] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:00:49.164622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:49.165007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:49.165189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:49.188038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:00:49.189161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:00:49.195887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 610/1220] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:00:49.218068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52389895-02be-4afa-8589-0d3c8fd87ad9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:49.229401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52389895-02be-4afa-8589-0d3c8fd87ad9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:49.233366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:49.234048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:49.234334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:49.234611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:49.235227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:49.260752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:49.271964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING keystone.server.flask.application [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 10:00:49.272983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 611/1221] 10.222.0.11 () {56 vars in 1138 bytes} [Wed Apr 6 10:00:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 10:00:49.278799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:49.287199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94739f-61c3-4f0c-b33f-e08c5ceb02c0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:49.291256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:49.291831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:49.292138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:49.292421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] PATH_INFO: `/v3/services` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:49.293090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:00:49.293389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:49.319152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6d973-5a92-44f6-94a7-ccbe0fcd7bfc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:49.324911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 611/1222] 10.222.0.11 () {56 vars in 1137 bytes} [Wed Apr 6 10:00:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:00:49.330297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:00:49.341346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82558e08-f9b9-45b4-866d-aae6f61c40e7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:00:49.345325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:00:49.345879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:00:49.346195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:00:49.346472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:00:49.347139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:00:49.372129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb612563-20fd-4eb2-95c7-ef4caad4b8af admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:00:49.460997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 612/1223] 10.222.0.11 () {60 vars in 1165 bytes} [Wed Apr 6 10:00:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:08:54.558576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:54.559188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:54.559188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:54.560807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 612/1224] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:08:54.566604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9fe1-4733-4814-8a8c-c2ed4edf1c02 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:54.567024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9fe1-4733-4814-8a8c-c2ed4edf1c02 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:54.567292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9fe1-4733-4814-8a8c-c2ed4edf1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:54.651008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f0fb9fe1-4733-4814-8a8c-c2ed4edf1c02 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:08:54.652048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f0fb9fe1-4733-4814-8a8c-c2ed4edf1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:54.761671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 613/1225] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:08:54.784831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:08:54.786738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:54.935642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032078-a0f1-4f6a-96a7-a338f8899251 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:08:55.052570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:08:55.053312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:55.053728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:55.054130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:55.055064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:08:55.082801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3850d-1821-432a-b4da-cf6dd72c497b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:08:55.099922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 613/1226] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 10:08:54 2022] GET /identity/v3/projects => generated 2553 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:08:57.212894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1811b-2664-4878-8f65-6a95e948310c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:57.213462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1811b-2664-4878-8f65-6a95e948310c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:57.213462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1811b-2664-4878-8f65-6a95e948310c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:57.215388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 614/1227] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:08:57.221606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f6dd-422e-46fd-b8be-a3f1a4efaa66 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:57.222249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f6dd-422e-46fd-b8be-a3f1a4efaa66 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:57.222249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f6dd-422e-46fd-b8be-a3f1a4efaa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:57.320271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3a72f6dd-422e-46fd-b8be-a3f1a4efaa66 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:08:57.321473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3a72f6dd-422e-46fd-b8be-a3f1a4efaa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:57.439577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 614/1228] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:08:57.489449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:57.489748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:57.490134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:57.491920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 615/1229] 10.222.0.11 () {54 vars in 963 bytes} [Wed Apr 6 10:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:08:57.497775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26377-14d7-4b0c-9a9a-a06c55c2e27c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:57.498106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26377-14d7-4b0c-9a9a-a06c55c2e27c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:57.498393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26377-14d7-4b0c-9a9a-a06c55c2e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:57.593386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f4c26377-14d7-4b0c-9a9a-a06c55c2e27c None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:08:57.595173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f4c26377-14d7-4b0c-9a9a-a06c55c2e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:57.682782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 615/1230] 10.222.0.11 () {58 vars in 1060 bytes} [Wed Apr 6 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:08:57.691971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:08:57.693393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:57.812697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9739d-9fa4-4d23-ac7b-c87c0f974c42 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:08:57.894227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:08:57.894732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:08:57.895021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:08:57.895304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:08:57.896817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:08:58.020518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:08:58.045519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e86eee-0d43-4f80-8edd-72cae1499918 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:08:58.066527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 616/1231] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:08:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:09:00.315439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:00.315955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:00.316145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:00.317667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 616/1232] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:00.322858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cbb89-c2b1-49c2-a5f4-77a682b4d6c2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:00.323307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cbb89-c2b1-49c2-a5f4-77a682b4d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:00.323422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cbb89-c2b1-49c2-a5f4-77a682b4d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:00.410021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-797cbb89-c2b1-49c2-a5f4-77a682b4d6c2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:00.411145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-797cbb89-c2b1-49c2-a5f4-77a682b4d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:00.514599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 617/1233] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:00.552331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:00.553762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:00.669679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71459-e806-4305-8996-3fc8fbc4fb37 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:00.768226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:00.768794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:00.769079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:00.769357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:00.771725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:00.894654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:00.920157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60749b66-6294-457a-bacf-d5eb11af751b service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:00.942883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 617/1234] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:03.602808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:03.603331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:03.603331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:03.604958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 618/1235] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:03.610215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:03.610588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:03.610790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:03.701472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:03.702659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:03.812009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 618/1236] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:03.846952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:03.848368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:03.985603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9726-93e2-4f12-a57d-4b7f4c672cd3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:04.088413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:04.089193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:04.089480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:04.089758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:04.100737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:04.125656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f02bd-98ed-492f-a086-3fdefae01112 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:04.127430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 619/1237] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:09:03 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:09:04.139519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:04.140638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:04.242604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeb633-8a66-4992-b481-59da22b3e51f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:04.325277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:04.325852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:04.326169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:04.326452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:04.327953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:04.447403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:04.472894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12beb6-203e-46f2-92aa-13527fd64968 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:04.492219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 619/1238] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:07.271762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:07.272292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:07.272292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:07.273952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 620/1239] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:07.279051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:07.279450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:07.279623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:07.365387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:07.366609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:07.472732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 620/1240] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:07.504443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:07.505850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:07.643919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c9e5-2a6c-4d92-a555-7017b9274ae6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:07.748058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:07.748840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:07.749182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:07.749465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:07.760319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:07.786866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17810f8c-ec52-4adf-971c-b20892dad3c3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:07.789063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 621/1241] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:09:07 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:09:07.801516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:07.802715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:07.906147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132a7f-cad9-4372-84da-e50d3ad8ac63 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:07.989063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:07.989691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:07.990009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:07.990295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:07.991820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:08.116281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:08.143271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6144f-2bb5-454a-88b1-06906f1803e0 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:08.164542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 621/1242] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:11.173739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d3f0-dc5d-4912-bfb5-14f6ac9d45eb None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:11.174310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d3f0-dc5d-4912-bfb5-14f6ac9d45eb None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:11.174310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d3f0-dc5d-4912-bfb5-14f6ac9d45eb None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:11.176013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 622/1243] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:11.181102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fdd7-08b6-4ad4-869f-38f19cb1a89a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:11.181521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fdd7-08b6-4ad4-869f-38f19cb1a89a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:11.181681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34fdd7-08b6-4ad4-869f-38f19cb1a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:11.267374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8b34fdd7-08b6-4ad4-869f-38f19cb1a89a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:11.268450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8b34fdd7-08b6-4ad4-869f-38f19cb1a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:11.374376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 622/1244] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:11.425088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:11.425468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:11.425820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:11.427533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 623/1245] 10.222.0.11 () {54 vars in 963 bytes} [Wed Apr 6 10:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:11.433704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86587f-98b9-4737-b87f-bd5cd3b8e49e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:11.434037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86587f-98b9-4737-b87f-bd5cd3b8e49e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:11.434324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86587f-98b9-4737-b87f-bd5cd3b8e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:11.542848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6d86587f-98b9-4737-b87f-bd5cd3b8e49e None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:11.544012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6d86587f-98b9-4737-b87f-bd5cd3b8e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:11.629287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 623/1246] 10.222.0.11 () {58 vars in 1060 bytes} [Wed Apr 6 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:11.638543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:11.639984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:11.766191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9598a-35c0-4dd9-b659-36c86aca29cb None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:11.852655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:11.853246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:11.853532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:11.853812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:11.855380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:11.978572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:12.003862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36d2b4-f311-4799-8ea6-aec3684f9936 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:12.025552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 624/1247] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:09:14.301441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:14.301954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:14.302163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:14.303778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 624/1248] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:14.309502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f63-1e99-41f1-967b-2209499d868e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:14.309970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f63-1e99-41f1-967b-2209499d868e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:14.310103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f63-1e99-41f1-967b-2209499d868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:14.410167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4de09f63-1e99-41f1-967b-2209499d868e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:14.411333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4de09f63-1e99-41f1-967b-2209499d868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:14.521686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 625/1249] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:14.557343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:14.558805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:14.683433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d6912-3d99-4c59-b72f-46f1c1abcf21 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:14.771605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:14.772188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:14.772475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:14.772750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:14.774286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:14.898341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:14.927767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8b7df-7039-44c4-815b-1153621851e8 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:14.948935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 625/1250] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:16.998361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:16.998940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:16.998940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:17.000670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 626/1251] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:17.006663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:17.007097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:17.007243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:17.092678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:17.093824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:17.278343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 626/1252] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:17.317877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:17.319479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:17.458906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107067b-1871-4642-9fa0-fcd5db40b0f5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:17.565563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:17.566470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:17.566754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:17.567030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:17.577581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:17.605195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9c1fd-9456-4ad9-b114-d9cef7cf2df8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:17.606852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 627/1253] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:09:17 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:09:17.618752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:17.619886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:17.723107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e52106-d419-4d6b-85aa-beef25d53783 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:17.811972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:17.812563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:17.812854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:17.813139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:17.815294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:17.936409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:17.961481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21c605-cb2f-47f8-b5d4-2bf9669efed4 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:17.983072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 627/1254] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:20.701627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:20.702252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:20.702252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:20.703882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 628/1255] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:20.709778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84029399-6d86-40be-859f-fbb020041b2d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:20.710257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84029399-6d86-40be-859f-fbb020041b2d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:20.710386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84029399-6d86-40be-859f-fbb020041b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:20.793910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-84029399-6d86-40be-859f-fbb020041b2d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:20.795081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-84029399-6d86-40be-859f-fbb020041b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:20.897391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 628/1256] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:09:20.933764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:20.935238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:21.062562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb327eb-6ab9-4164-a731-57d0739d5f80 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:21.145399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:21.146004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:21.146297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:21.146578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:21.148118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:21.268372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:21.293552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49882f3c-8315-4dc2-8790-9d0e365b8c35 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:21.320887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 629/1257] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:23.387256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:23.387757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:23.387862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:23.389558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 629/1258] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:23.395158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57e94-098e-4575-a3c0-2561525a75e0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:23.395597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57e94-098e-4575-a3c0-2561525a75e0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:23.395703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be57e94-098e-4575-a3c0-2561525a75e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:23.480140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-1be57e94-098e-4575-a3c0-2561525a75e0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:23.481276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1be57e94-098e-4575-a3c0-2561525a75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:23.588869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 630/1259] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:23.628409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:23.629847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:23.750337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeebab-bc64-4d94-8466-c2107382baee None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:23.832868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:23.833448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:23.833737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:23.834047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:23.835597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:23.955402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:23.980597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f213f-bba1-4447-aa65-18775234c4d1 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:24.000495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 630/1260] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:26.852544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:26.853108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:26.853108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:26.854810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 631/1261] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:26.860611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c0f9-9889-46bb-9890-665fdec8b0d0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:26.861182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c0f9-9889-46bb-9890-665fdec8b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:26.861182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770c0f9-9889-46bb-9890-665fdec8b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:26.978619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6770c0f9-9889-46bb-9890-665fdec8b0d0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:26.979759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6770c0f9-9889-46bb-9890-665fdec8b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:27.102331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 631/1262] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:27.137549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:27.139517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:27.248047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429cb-ac1a-44d4-b662-5654bbba584e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:27.252402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:27.252978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:27.253263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:27.253538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:27.262061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:27.287509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07617c8-2db4-4a0d-8d3d-403524a73b95 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:27.296263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 632/1263] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:31.823554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:31.824098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:31.824203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:31.825973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 632/1264] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:31.832189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74bfcc-0c71-4547-878c-73f48cdef4de None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:31.832617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74bfcc-0c71-4547-878c-73f48cdef4de None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:31.832755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74bfcc-0c71-4547-878c-73f48cdef4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:31.857181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-9f74bfcc-0c71-4547-878c-73f48cdef4de None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:31.858267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-9f74bfcc-0c71-4547-878c-73f48cdef4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:31.867102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 633/1265] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:31.904737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:31.906381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:31.919869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3c06-f3c8-4747-9d43-3cdff880b878 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:31.923640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:31.924218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:31.924503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:31.924781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:31.933323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:31.960325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e95cd7-6e07-4dc0-b3f7-a34d5d9ea1ff service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:31.971024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 633/1266] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:35.130753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438741-eafe-47d4-aa92-9797e7eeafec None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:35.131313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438741-eafe-47d4-aa92-9797e7eeafec None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:35.131313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438741-eafe-47d4-aa92-9797e7eeafec None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:35.132972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 634/1267] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:35.138160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe69d8-b8ff-406b-ba20-261cb82e0e7e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:35.138581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe69d8-b8ff-406b-ba20-261cb82e0e7e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:35.138758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe69d8-b8ff-406b-ba20-261cb82e0e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:35.161899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-defe69d8-b8ff-406b-ba20-261cb82e0e7e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:35.163074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-defe69d8-b8ff-406b-ba20-261cb82e0e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:35.170032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 634/1268] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:35.206934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de438741-eafe-47d4-aa92-9797e7eeafec None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:35.217094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de438741-eafe-47d4-aa92-9797e7eeafec None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:35.222309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:35.222309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:35.222309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:35.222309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:35.231472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:35.256831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc16314-239e-4b4c-b270-e2513e465725 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:35.266736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 635/1269] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:39.929210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76f23-d135-4828-b18e-e71bf22e551e None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:39.929731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76f23-d135-4828-b18e-e71bf22e551e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:39.929731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76f23-d135-4828-b18e-e71bf22e551e None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:39.931378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 635/1270] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:39.936796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a832eb-e419-4990-81f4-fe2b14f8ac34 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:39.937244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a832eb-e419-4990-81f4-fe2b14f8ac34 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:39.937386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a832eb-e419-4990-81f4-fe2b14f8ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:40.040774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-10a832eb-e419-4990-81f4-fe2b14f8ac34 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:40.041923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-10a832eb-e419-4990-81f4-fe2b14f8ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:40.050214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 636/1271] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:40.088073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af76f23-d135-4828-b18e-e71bf22e551e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:40.099608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af76f23-d135-4828-b18e-e71bf22e551e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:40.103033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:40.103625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:40.103907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:40.104185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:40.114643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:40.140711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258d5c-f4a5-4528-9c4c-8380832bfa13 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:40.151277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 636/1272] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:44.885002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7ce0-df06-4576-a29b-f37d270fcdaa None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:44.885540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7ce0-df06-4576-a29b-f37d270fcdaa None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:44.885648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7ce0-df06-4576-a29b-f37d270fcdaa None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:44.889084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 637/1273] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:44.893736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571191-df6c-41a8-8741-78688029307b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:44.894214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571191-df6c-41a8-8741-78688029307b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:44.894558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571191-df6c-41a8-8741-78688029307b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:45.010776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4f571191-df6c-41a8-8741-78688029307b None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:45.011921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4f571191-df6c-41a8-8741-78688029307b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:45.118191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 637/1274] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:45.541906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d322c-b889-48d6-b488-a138cef208cf None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:45.542599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d322c-b889-48d6-b488-a138cef208cf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:45.543084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d322c-b889-48d6-b488-a138cef208cf None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:45.545211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 638/1275] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:45.550828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f219a6-9fe8-4fdc-bfb4-05e73e4a2dab None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:45.551123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f219a6-9fe8-4fdc-bfb4-05e73e4a2dab None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:45.551405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f219a6-9fe8-4fdc-bfb4-05e73e4a2dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:45.591464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c5f219a6-9fe8-4fdc-bfb4-05e73e4a2dab None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:45.592621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c5f219a6-9fe8-4fdc-bfb4-05e73e4a2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:45.602421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 638/1276] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:09:45 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:49.425163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e77e2-f8da-4776-b62a-33ce3b35375f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:49.425746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e77e2-f8da-4776-b62a-33ce3b35375f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:49.425746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e77e2-f8da-4776-b62a-33ce3b35375f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:49.427395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 639/1277] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:49.432334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256261-6640-4515-b591-25b45b4923ac None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:49.432764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256261-6640-4515-b591-25b45b4923ac None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:49.432890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256261-6640-4515-b591-25b45b4923ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:49.455060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6c256261-6640-4515-b591-25b45b4923ac None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:49.456294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6c256261-6640-4515-b591-25b45b4923ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:49.463740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 639/1278] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:09:49 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:50.956963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23d48-7a62-4c63-af91-dbf30a9b36d4 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:50.957510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23d48-7a62-4c63-af91-dbf30a9b36d4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:50.957510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23d48-7a62-4c63-af91-dbf30a9b36d4 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:50.959213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 640/1279] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:50.964322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a26-0c25-4bb3-be6f-c8564833dd9f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:50.964768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a26-0c25-4bb3-be6f-c8564833dd9f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:50.964972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a26-0c25-4bb3-be6f-c8564833dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:50.990156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-96273a26-0c25-4bb3-be6f-c8564833dd9f None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:50.991412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-96273a26-0c25-4bb3-be6f-c8564833dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:50.999120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 640/1280] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:09:50 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:54.279976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b04fe-193e-4b30-96d7-5dcf19e64f4d None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:54.280481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b04fe-193e-4b30-96d7-5dcf19e64f4d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:54.280481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b04fe-193e-4b30-96d7-5dcf19e64f4d None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:54.283109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 641/1281] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:54.288239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2381-d5b2-49bd-8102-5f3e877a1f82 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:54.288666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2381-d5b2-49bd-8102-5f3e877a1f82 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:54.288833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe2381-d5b2-49bd-8102-5f3e877a1f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:54.310664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-bdbe2381-d5b2-49bd-8102-5f3e877a1f82 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:54.311790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bdbe2381-d5b2-49bd-8102-5f3e877a1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:54.318964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 641/1282] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:54.408710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84602a6-06d6-48a7-a87d-7a6d888b3fa5 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:54.409006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84602a6-06d6-48a7-a87d-7a6d888b3fa5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:54.409316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84602a6-06d6-48a7-a87d-7a6d888b3fa5 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:54.411079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 642/1283] 10.222.0.11 () {54 vars in 954 bytes} [Wed Apr 6 10:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:54.416171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae80d-2255-40b6-8305-c3f4d50c2dab None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:54.416464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae80d-2255-40b6-8305-c3f4d50c2dab None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:54.416746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae80d-2255-40b6-8305-c3f4d50c2dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:54.482756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-27bae80d-2255-40b6-8305-c3f4d50c2dab None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:54.483901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-27bae80d-2255-40b6-8305-c3f4d50c2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:54.570169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 642/1284] 10.222.0.11 () {58 vars in 1051 bytes} [Wed Apr 6 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:54.578046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84602a6-06d6-48a7-a87d-7a6d888b3fa5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:54.591673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84602a6-06d6-48a7-a87d-7a6d888b3fa5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:54.596730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:54.597295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:54.597601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:54.597875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:54.605585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:54.630590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c702f2-8598-44fa-94b6-ebea270596a8 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:54.640111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 643/1285] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:56.849283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad46a0-21de-486b-886d-9aefb94aa722 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:56.849845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad46a0-21de-486b-886d-9aefb94aa722 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:56.849845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad46a0-21de-486b-886d-9aefb94aa722 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:56.851534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 643/1286] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:09:56.856569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5baca-07f6-43c6-8208-e56d8867cb80 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:56.856992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5baca-07f6-43c6-8208-e56d8867cb80 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:56.857138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5baca-07f6-43c6-8208-e56d8867cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:56.879748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-80f5baca-07f6-43c6-8208-e56d8867cb80 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:56.880886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-80f5baca-07f6-43c6-8208-e56d8867cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:56.888117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 644/1287] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:56.981765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ab2c0-3cb5-4c59-b7d6-65fffce2fd84 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:56.982094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ab2c0-3cb5-4c59-b7d6-65fffce2fd84 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:56.982386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ab2c0-3cb5-4c59-b7d6-65fffce2fd84 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:56.984114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 644/1288] 10.222.0.11 () {54 vars in 954 bytes} [Wed Apr 6 10:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:56.989324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d81be9-ae9a-456f-8ad3-4a5aac851fe8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:56.989622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d81be9-ae9a-456f-8ad3-4a5aac851fe8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:56.989909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d81be9-ae9a-456f-8ad3-4a5aac851fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:57.012866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-29d81be9-ae9a-456f-8ad3-4a5aac851fe8 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:57.014069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-29d81be9-ae9a-456f-8ad3-4a5aac851fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:57.023413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 645/1289] 10.222.0.11 () {58 vars in 1051 bytes} [Wed Apr 6 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:09:57.031695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ab2c0-3cb5-4c59-b7d6-65fffce2fd84 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:57.044819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ab2c0-3cb5-4c59-b7d6-65fffce2fd84 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:57.049799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:57.050428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:57.050721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:57.051006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:57.059026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:57.085896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358616e-e56a-49a0-beae-4e00730434fd service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:57.095235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 645/1290] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:09:59.583558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72987-50c8-46d8-aa8f-fbd63e0d835a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:59.584086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72987-50c8-46d8-aa8f-fbd63e0d835a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:59.584086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72987-50c8-46d8-aa8f-fbd63e0d835a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:59.585784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 646/1291] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:09:59.591017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017b10-d580-4022-92bd-6cc03bba4e17 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:59.591457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017b10-d580-4022-92bd-6cc03bba4e17 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:59.591584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01017b10-d580-4022-92bd-6cc03bba4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:59.614796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-01017b10-d580-4022-92bd-6cc03bba4e17 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:09:59.615837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-01017b10-d580-4022-92bd-6cc03bba4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:09:59.622751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 646/1292] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:09:59.709300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72987-50c8-46d8-aa8f-fbd63e0d835a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:09:59.723091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72987-50c8-46d8-aa8f-fbd63e0d835a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:09:59.727976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:09:59.728544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:09:59.728832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:09:59.729114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:09:59.737467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:09:59.762751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef644-799d-473e-b63e-b7ce822e3797 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:09:59.771704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 647/1293] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:09:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:02.170673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c21b-86bd-440e-8dd3-1f78584bbb1c None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:02.171225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c21b-86bd-440e-8dd3-1f78584bbb1c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:02.171225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c21b-86bd-440e-8dd3-1f78584bbb1c None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:02.173837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 647/1294] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:02.179027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77fde-52da-456f-99ac-18cea6cd5832 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:02.179474 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77fde-52da-456f-99ac-18cea6cd5832 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:02.179591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77fde-52da-456f-99ac-18cea6cd5832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:02.201662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-65e77fde-52da-456f-99ac-18cea6cd5832 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:02.202817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-65e77fde-52da-456f-99ac-18cea6cd5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:02.210118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 648/1295] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:02.299863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c21b-86bd-440e-8dd3-1f78584bbb1c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:02.313233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c21b-86bd-440e-8dd3-1f78584bbb1c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:02.318732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:02.319296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:02.319579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:02.319856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:02.327680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:02.353353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3ab18-40f1-4dfa-9829-fc7c77d31f88 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:02.362812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 648/1296] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:04.726493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad2a-4d98-49a0-acf0-538032e33d5f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:04.727075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad2a-4d98-49a0-acf0-538032e33d5f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:04.727075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad2a-4d98-49a0-acf0-538032e33d5f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:04.728772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 649/1297] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:04.734147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c20413-24a9-4c55-b7a6-f53e9e01d24a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:04.734594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c20413-24a9-4c55-b7a6-f53e9e01d24a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:04.734867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c20413-24a9-4c55-b7a6-f53e9e01d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:04.758264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-79c20413-24a9-4c55-b7a6-f53e9e01d24a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:04.759402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-79c20413-24a9-4c55-b7a6-f53e9e01d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:04.766846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 649/1298] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:04.853870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ad2a-4d98-49a0-acf0-538032e33d5f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:04.867311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ad2a-4d98-49a0-acf0-538032e33d5f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:04.872163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:04.872741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:04.873030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:04.873312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:04.881029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:04.906169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9b8b3-e0b0-4022-a6d2-39b32b4eba56 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:04.915991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 650/1299] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:07.123903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a055-602f-48e8-b293-3d17faeaa666 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:07.124466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a055-602f-48e8-b293-3d17faeaa666 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:07.124466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a055-602f-48e8-b293-3d17faeaa666 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:07.126990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 650/1300] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:07.132238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad388-d93f-46cd-b822-d52f59f5e8fe None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:07.132645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad388-d93f-46cd-b822-d52f59f5e8fe None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:07.132803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adad388-d93f-46cd-b822-d52f59f5e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:07.154582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4adad388-d93f-46cd-b822-d52f59f5e8fe None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:07.155706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4adad388-d93f-46cd-b822-d52f59f5e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:07.162938 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 651/1301] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:07.248632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41a055-602f-48e8-b293-3d17faeaa666 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:07.262135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41a055-602f-48e8-b293-3d17faeaa666 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:07.266991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:07.267554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:07.267838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:07.268119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:07.275806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:07.301767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c73f77-823b-4959-a4cc-ee22e4111def service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:07.310508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 651/1302] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:09.667445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285456c2-83d6-47a4-97d4-3ac9b2f54e5c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:09.667962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285456c2-83d6-47a4-97d4-3ac9b2f54e5c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:09.667962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285456c2-83d6-47a4-97d4-3ac9b2f54e5c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:09.669602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 652/1303] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:09.675438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092574-6922-4498-aeec-83b005bddcba None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:09.675867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092574-6922-4498-aeec-83b005bddcba None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:09.676004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092574-6922-4498-aeec-83b005bddcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:09.698234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ec092574-6922-4498-aeec-83b005bddcba None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:09.699351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ec092574-6922-4498-aeec-83b005bddcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:09.706348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 652/1304] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:10:09.790364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285456c2-83d6-47a4-97d4-3ac9b2f54e5c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:09.805279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285456c2-83d6-47a4-97d4-3ac9b2f54e5c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:09.810166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:09.810736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:09.811023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:09.811304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:09.819517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:09.844022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae55b6-bdaf-42cd-9f85-7db07d281252 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:09.853525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 653/1305] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:11.825343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e770ec-225b-44a6-a211-59dabc4f48aa None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:11.825907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e770ec-225b-44a6-a211-59dabc4f48aa None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:11.825907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e770ec-225b-44a6-a211-59dabc4f48aa None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:11.827596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 653/1306] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:11.833542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02737404-a684-4f5f-b06f-b4caab229364 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:11.833997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02737404-a684-4f5f-b06f-b4caab229364 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:11.834139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02737404-a684-4f5f-b06f-b4caab229364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:11.856198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-02737404-a684-4f5f-b06f-b4caab229364 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:11.857333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-02737404-a684-4f5f-b06f-b4caab229364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:11.864378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 654/1307] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:11.953493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e770ec-225b-44a6-a211-59dabc4f48aa None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:11.968143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e770ec-225b-44a6-a211-59dabc4f48aa None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:11.974082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:11.974654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:11.974939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:11.975218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:11.982975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:12.009462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30a389-656e-4ed8-817c-686f8d2ecbf8 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:12.019565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 654/1308] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:14.243962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d154d-b5d5-43d0-9cdc-975f73cf2b52 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:14.244489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d154d-b5d5-43d0-9cdc-975f73cf2b52 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:14.244602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d154d-b5d5-43d0-9cdc-975f73cf2b52 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:14.246320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 655/1309] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:14.251436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b18b-93bf-4686-a285-a2de81dd8822 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:14.251863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b18b-93bf-4686-a285-a2de81dd8822 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:14.252029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9b18b-93bf-4686-a285-a2de81dd8822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:14.274157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6df9b18b-93bf-4686-a285-a2de81dd8822 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:14.275327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6df9b18b-93bf-4686-a285-a2de81dd8822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:14.283232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 655/1310] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:14.370378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d154d-b5d5-43d0-9cdc-975f73cf2b52 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:14.383979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d154d-b5d5-43d0-9cdc-975f73cf2b52 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:14.388769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:14.389327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:14.389611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:14.389917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:14.398537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:14.425026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeefe4f-078e-4ebb-93f5-f5cdc5dd45b3 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:14.433797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 656/1311] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:16.608105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77fecc-2552-42a1-80f0-2970f506b6b0 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:16.608665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77fecc-2552-42a1-80f0-2970f506b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:16.608665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77fecc-2552-42a1-80f0-2970f506b6b0 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:16.610559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 656/1312] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:16.616011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cb3b-e4d4-4de6-b433-0e3fb398e153 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:16.616439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cb3b-e4d4-4de6-b433-0e3fb398e153 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:16.616580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cb3b-e4d4-4de6-b433-0e3fb398e153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:16.639041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4a69cb3b-e4d4-4de6-b433-0e3fb398e153 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:16.640170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4a69cb3b-e4d4-4de6-b433-0e3fb398e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:16.647876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 657/1313] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:10:16.733796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77fecc-2552-42a1-80f0-2970f506b6b0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:16.748069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77fecc-2552-42a1-80f0-2970f506b6b0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:16.754033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:16.754602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:16.754885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:16.755164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:16.762811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:16.788610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6009a-df4d-46c2-81e7-373c27eccc0e service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:16.797335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 657/1314] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:19.031023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51173501-033e-44ed-a708-20289d33c650 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:19.031748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51173501-033e-44ed-a708-20289d33c650 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:19.032056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51173501-033e-44ed-a708-20289d33c650 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:19.034151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 658/1315] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:19.039377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e541da-089d-4aa6-904a-9a81241a09c0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:19.039827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e541da-089d-4aa6-904a-9a81241a09c0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:19.039928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e541da-089d-4aa6-904a-9a81241a09c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:19.062315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-36e541da-089d-4aa6-904a-9a81241a09c0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:19.063484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-36e541da-089d-4aa6-904a-9a81241a09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:19.070502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 658/1316] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:19.158503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51173501-033e-44ed-a708-20289d33c650 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:19.171716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51173501-033e-44ed-a708-20289d33c650 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:19.176995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:19.177560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:19.177845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:19.178157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:19.185814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:19.211834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ebd1c-5fa0-4d36-ba81-a06523e61cf8 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:19.221816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 659/1317] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:21.443372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d067a7-ca74-49fd-b99c-c2914eb9ba6b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:21.443947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d067a7-ca74-49fd-b99c-c2914eb9ba6b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:21.443947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d067a7-ca74-49fd-b99c-c2914eb9ba6b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:21.445593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 659/1318] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:21.450825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f233d-af14-42e4-bd83-1b87e9f62606 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:21.451225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f233d-af14-42e4-bd83-1b87e9f62606 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:21.451404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f233d-af14-42e4-bd83-1b87e9f62606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:21.475336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-651f233d-af14-42e4-bd83-1b87e9f62606 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:21.476471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-651f233d-af14-42e4-bd83-1b87e9f62606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:21.483434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 660/1319] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:10:21.572831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d067a7-ca74-49fd-b99c-c2914eb9ba6b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:21.586554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d067a7-ca74-49fd-b99c-c2914eb9ba6b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:21.591406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:21.591970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:21.592258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:21.592539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:21.600371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:21.626695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028be935-6845-42a6-a2df-6f9e22e939cf service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:21.635234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 660/1320] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:31.967799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907557-a1af-4492-a782-e53bbfc2a051 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:31.968360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907557-a1af-4492-a782-e53bbfc2a051 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:31.968360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907557-a1af-4492-a782-e53bbfc2a051 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:31.970264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 661/1321] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:31.975368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f53a-bebf-4a74-a50b-7325387386a6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:31.976167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f53a-bebf-4a74-a50b-7325387386a6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:31.976454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f53a-bebf-4a74-a50b-7325387386a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:32.000151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8065f53a-bebf-4a74-a50b-7325387386a6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:32.002300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8065f53a-bebf-4a74-a50b-7325387386a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:32.009461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 661/1322] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:32.071873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9900f3-0bd6-4374-8069-a9a932936ff2 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:32.072180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9900f3-0bd6-4374-8069-a9a932936ff2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:32.072468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9900f3-0bd6-4374-8069-a9a932936ff2 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:32.074178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 662/1323] 10.222.0.11 () {54 vars in 961 bytes} [Wed Apr 6 10:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:32.078891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8eb47-0faf-4ec0-bba7-ea39cc582774 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:32.079359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8eb47-0faf-4ec0-bba7-ea39cc582774 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:32.079651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8eb47-0faf-4ec0-bba7-ea39cc582774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:32.147088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-66f8eb47-0faf-4ec0-bba7-ea39cc582774 None None] MFA Rules not processed for user `125ce3f900a94e639c62b77d4f7d9c81`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:32.148231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-66f8eb47-0faf-4ec0-bba7-ea39cc582774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:32.220710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 662/1324] 10.222.0.11 () {58 vars in 1058 bytes} [Wed Apr 6 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:32.228439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9900f3-0bd6-4374-8069-a9a932936ff2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:32.238781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9900f3-0bd6-4374-8069-a9a932936ff2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:32.242131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:32.242698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:32.242990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:32.243433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:32.252538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:32.278531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902b901-7afd-49b9-8606-293fc878da40 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:32.288631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 663/1325] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:46.142976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e56cd9-2da2-4dc8-9ec2-d589757edccb None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.143529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e56cd9-2da2-4dc8-9ec2-d589757edccb None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.143634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e56cd9-2da2-4dc8-9ec2-d589757edccb None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:46.145249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 663/1326] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:46.150553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc350a5-63a1-4c47-aa4c-67b7b51de289 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.150974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc350a5-63a1-4c47-aa4c-67b7b51de289 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.151118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc350a5-63a1-4c47-aa4c-67b7b51de289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:46.174115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0bc350a5-63a1-4c47-aa4c-67b7b51de289 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:46.175247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0bc350a5-63a1-4c47-aa4c-67b7b51de289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:46.182060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 664/1327] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:46.243412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f72d-7644-4fc8-aeb5-b251ddcdf2b7 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.243751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f72d-7644-4fc8-aeb5-b251ddcdf2b7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.244033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f72d-7644-4fc8-aeb5-b251ddcdf2b7 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:46.245710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 664/1328] 10.222.0.11 () {54 vars in 961 bytes} [Wed Apr 6 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:46.252654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffea44-5654-495a-a171-15b4d3c66492 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.252885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffea44-5654-495a-a171-15b4d3c66492 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.253166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffea44-5654-495a-a171-15b4d3c66492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:46.321362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b8ffea44-5654-495a-a171-15b4d3c66492 None None] MFA Rules not processed for user `91fdfcc74542409cb3c1b0ac2ea8c052`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:46.322530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b8ffea44-5654-495a-a171-15b4d3c66492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:46.387743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 665/1329] 10.222.0.11 () {58 vars in 1058 bytes} [Wed Apr 6 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:46.396794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f72d-7644-4fc8-aeb5-b251ddcdf2b7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:46.408066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f72d-7644-4fc8-aeb5-b251ddcdf2b7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:46.411347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:46.411918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.412209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.412493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:46.420922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:46.446213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb755ae-186a-4006-9963-e72f2a17f9b4 service glance] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:46.455142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 665/1330] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:10:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:10:46.978622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa33c4-f5c5-4bea-8e0a-f1855cb3a39b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:46.978921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa33c4-f5c5-4bea-8e0a-f1855cb3a39b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:46.979207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa33c4-f5c5-4bea-8e0a-f1855cb3a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:47.046078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-35fa33c4-f5c5-4bea-8e0a-f1855cb3a39b None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:47.047361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-35fa33c4-f5c5-4bea-8e0a-f1855cb3a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:47.116867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 666/1331] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:10:46 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:47.157968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae166ba-d5a1-43b2-a02c-d705c6cc91f9 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:47.158423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae166ba-d5a1-43b2-a02c-d705c6cc91f9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:47.158514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae166ba-d5a1-43b2-a02c-d705c6cc91f9 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:47.160199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 666/1332] 10.222.0.11 () {54 vars in 942 bytes} [Wed Apr 6 10:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:10:47.166388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d298ac-d404-4fea-9eda-8dd1947067bf None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:47.166815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d298ac-d404-4fea-9eda-8dd1947067bf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:47.166987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d298ac-d404-4fea-9eda-8dd1947067bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:47.234071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b0d298ac-d404-4fea-9eda-8dd1947067bf None None] MFA Rules not processed for user `050f0daf1aca4b498319ce5c265ec2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:10:47.235841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b0d298ac-d404-4fea-9eda-8dd1947067bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:10:47.312219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 667/1333] 10.222.0.11 () {58 vars in 1039 bytes} [Wed Apr 6 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:10:47.320794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae166ba-d5a1-43b2-a02c-d705c6cc91f9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:10:47.333423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae166ba-d5a1-43b2-a02c-d705c6cc91f9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:10:47.337818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:10:47.338424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:10:47.338715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:10:47.338991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:10:47.347292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:10:47.373059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2189-36f8-4983-9b48-a50cce72a353 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:10:47.380458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 667/1334] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:11:08.134299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c55b03-8f48-4100-b425-030a7d8f7c21 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:08.134869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c55b03-8f48-4100-b425-030a7d8f7c21 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:08.134869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c55b03-8f48-4100-b425-030a7d8f7c21 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:08.136547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 668/1335] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:08.141809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba701-538f-4b69-b30d-c3e534151791 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:08.142271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba701-538f-4b69-b30d-c3e534151791 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:08.142420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba701-538f-4b69-b30d-c3e534151791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:08.165430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-decba701-538f-4b69-b30d-c3e534151791 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:08.166594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-decba701-538f-4b69-b30d-c3e534151791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:08.174366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 668/1336] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:11:08.198770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c55b03-8f48-4100-b425-030a7d8f7c21 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:08.210823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c55b03-8f48-4100-b425-030a7d8f7c21 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:08.214781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:08.215350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:08.215631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:08.215906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:08.216592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:08.243997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9b1b0-6af4-4814-b64e-62754c5a907a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:08.259561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 669/1337] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 10:11:08 2022] GET /identity/v3/projects => generated 2553 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:11:10.252709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b0aa-5480-4a2e-a6a7-7c39a68239b0 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.253247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b0aa-5480-4a2e-a6a7-7c39a68239b0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.253247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344b0aa-5480-4a2e-a6a7-7c39a68239b0 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.254898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 669/1338] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:10.260010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.260467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.260573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.283826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:10.284952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:10.291746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 670/1339] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:11:10.313793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344b0aa-5480-4a2e-a6a7-7c39a68239b0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:10.325807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344b0aa-5480-4a2e-a6a7-7c39a68239b0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:10.330157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:10.330941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.331231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.331514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] PATH_INFO: `/v3/projects/20846fe3d47240a4b10b2d8af0ced17b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.347467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] RBAC: Authorizing `identity:get_project(project_id=20846fe3d47240a4b10b2d8af0ced17b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:10.373400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:10.375369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 670/1340] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:10 2022] GET /identity/v3/projects/20846fe3d47240a4b10b2d8af0ced17b => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:10.381677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:10.391020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e72d0-1bca-48f6-958f-9ad644605d64 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:10.395136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:10.395715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.395998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.396274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.397270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] RBAC: Adding query filter params (scope.project.id=20846fe3d47240a4b10b2d8af0ced17b) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:10.397567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:10.424295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:10.430311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 671/1341] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:10 2022] GET /identity/v3/role_assignments?scope.project.id=20846fe3d47240a4b10b2d8af0ced17b => generated 877 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:10.436125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:10.445637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff2b6-a493-470d-a5b4-7fc90c6f7f88 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:10.449733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:10.450552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.450841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.451120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] PATH_INFO: `/v3/users/48013c3fc27949a3a8e606712614aad5` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.470014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] RBAC: Authorizing `identity:get_user(user_id=48013c3fc27949a3a8e606712614aad5)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:10.495599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3d2a-acdb-47cd-bddb-a43f53e1ff22 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:10.497087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 671/1342] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:10 2022] GET /identity/v3/users/48013c3fc27949a3a8e606712614aad5 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:10.503110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:10.513172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68c9bf-ad00-4751-b0f0-ce8b167abd9c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:10.517404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:10.518268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:10.518556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:10.518835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] PATH_INFO: `/v3/users/2810a7e9427544109bcdf9c746886128` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:10.538227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] RBAC: Authorizing `identity:get_user(user_id=2810a7e9427544109bcdf9c746886128)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:10.564031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe797ba-3870-4038-95dc-40f811239971 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:10.565522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 672/1343] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:10 2022] GET /identity/v3/users/2810a7e9427544109bcdf9c746886128 => generated 285 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:12.688696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a2b3-246c-4f58-bc19-bbea6b05707f None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:12.689282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a2b3-246c-4f58-bc19-bbea6b05707f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:12.689282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a2b3-246c-4f58-bc19-bbea6b05707f None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:12.690979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 672/1344] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:12.696247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058884-a361-4627-abc8-e888819caf0f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:12.696647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058884-a361-4627-abc8-e888819caf0f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:12.696810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058884-a361-4627-abc8-e888819caf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:12.727977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6f058884-a361-4627-abc8-e888819caf0f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:12.729871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6f058884-a361-4627-abc8-e888819caf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:12.740202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 673/1345] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:12.762143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a2b3-246c-4f58-bc19-bbea6b05707f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:12.774044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a2b3-246c-4f58-bc19-bbea6b05707f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:12.778102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:12.778875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:12.779165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:12.779453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] PATH_INFO: `/v3/projects/243059ad00e449c5acfc061092a4626d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:12.781292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] RBAC: Authorizing `identity:get_project(project_id=243059ad00e449c5acfc061092a4626d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:12.807098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:12.808619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 673/1346] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:12 2022] GET /identity/v3/projects/243059ad00e449c5acfc061092a4626d => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:12.814622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058884-a361-4627-abc8-e888819caf0f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:12.823274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058884-a361-4627-abc8-e888819caf0f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:12.827486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:12.828086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:12.828376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:12.828659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:12.829379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] RBAC: Adding query filter params (scope.project.id=243059ad00e449c5acfc061092a4626d) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:12.829680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:12.855036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebf84-696e-4f7d-8526-c3a462012e91 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:12.861205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 674/1347] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:12 2022] GET /identity/v3/role_assignments?scope.project.id=243059ad00e449c5acfc061092a4626d => generated 879 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:12.866963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:12.876155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19b24-bb2c-4536-9781-6a0e42aa509e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:12.880336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:12.881112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:12.881401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:12.881685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:12.882791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:12.908982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5701c55-05b0-43a1-a9aa-1bbb73bd69bf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:12.910463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 674/1348] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:12 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:14.920227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e8e9-53ac-4f45-8b63-de790922948c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:14.920767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e8e9-53ac-4f45-8b63-de790922948c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:14.920767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9e8e9-53ac-4f45-8b63-de790922948c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:14.922629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 675/1349] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:14.927746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:14.928136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:14.938074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:14.951232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:14.952431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:14.960554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 675/1350] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:14.982522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e8e9-53ac-4f45-8b63-de790922948c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:14.994320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9e8e9-53ac-4f45-8b63-de790922948c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:14.998422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:14.999695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:14.999979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:15.000342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] PATH_INFO: `/v3/projects/3aa39309e982455fa4b149aac03c5e3d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:15.012782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] RBAC: Authorizing `identity:get_project(project_id=3aa39309e982455fa4b149aac03c5e3d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:15.038838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:15.040403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 676/1351] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:14 2022] GET /identity/v3/projects/3aa39309e982455fa4b149aac03c5e3d => generated 361 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:15.046358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:15.055215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5953d7e-1b65-4b4e-b9b0-910af102aab0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:15.059534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:15.060112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:15.060394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:15.060671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:15.061394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] RBAC: Adding query filter params (scope.project.id=3aa39309e982455fa4b149aac03c5e3d) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:15.062730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:15.088777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e13887-c92b-4e2a-a22c-7c70eea4a074 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:15.094625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 676/1352] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:15 2022] GET /identity/v3/role_assignments?scope.project.id=3aa39309e982455fa4b149aac03c5e3d => generated 526 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:15.100222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:15.109372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bd5a-8e87-476a-87d2-89792f51ad0e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:15.113408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:15.114211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:15.114494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:15.114771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] PATH_INFO: `/v3/users/251546c97f4541bda763d1ee84dc4edf` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:15.133648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] RBAC: Authorizing `identity:get_user(user_id=251546c97f4541bda763d1ee84dc4edf)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:15.159961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55304906-8b3d-4177-b794-9d2e1c24cc78 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:15.161554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 677/1353] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:15 2022] GET /identity/v3/users/251546c97f4541bda763d1ee84dc4edf => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:17.168273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e866-55ad-41b0-8ae8-cb42a3659811 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.168794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e866-55ad-41b0-8ae8-cb42a3659811 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.168884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09e866-55ad-41b0-8ae8-cb42a3659811 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.170596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 677/1354] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:17.176495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.176916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.177059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.199170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:17.200322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:17.207157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 678/1355] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:17.229878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e866-55ad-41b0-8ae8-cb42a3659811 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:17.242187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09e866-55ad-41b0-8ae8-cb42a3659811 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:17.246290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:17.247066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.247355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.247639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] PATH_INFO: `/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.260004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] RBAC: Authorizing `identity:get_project(project_id=43c06c5abccc4ef5a867d99a20b4dd18)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:17.286313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:17.287886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 678/1356] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:17 2022] GET /identity/v3/projects/43c06c5abccc4ef5a867d99a20b4dd18 => generated 302 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:17.293743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:17.303361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f69ac7-d3dd-4226-9379-6705dd223690 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:17.307461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:17.308030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.308311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.308588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.309297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] RBAC: Adding query filter params (scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:17.309592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:17.335075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:17.341512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 679/1357] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:17 2022] GET /identity/v3/role_assignments?scope.project.id=43c06c5abccc4ef5a867d99a20b4dd18 => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:11:17.347868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:17.357199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c8a4b-7a26-4718-88ab-d39775a79b44 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:17.362097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:17.362875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.363159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.363434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.364502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:17.390328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19b7f0-061f-42e2-aa89-66c268cf724c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:17.394978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 679/1358] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:17 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:17.400755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:17.411458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead03b5-c98c-49c5-806a-146e319b16db admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:17.415600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:17.416378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:17.416659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:17.416931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] PATH_INFO: `/v3/users/50654ae35136436d96531de099d2b865` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:17.435110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] RBAC: Authorizing `identity:get_user(user_id=50654ae35136436d96531de099d2b865)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:17.460671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469351d0-62db-4144-a348-e0a2afa6f871 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:17.462186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 680/1359] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:17 2022] GET /identity/v3/users/50654ae35136436d96531de099d2b865 => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:19.533397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6f55-9b9b-4b6e-9f2b-c8ceace94456 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:19.533970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6f55-9b9b-4b6e-9f2b-c8ceace94456 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:19.533970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f6f55-9b9b-4b6e-9f2b-c8ceace94456 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:19.535674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 680/1360] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:19.540855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:19.541256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:19.541409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:19.564182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:19.565308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:19.572250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 681/1361] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:19.594188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f6f55-9b9b-4b6e-9f2b-c8ceace94456 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:19.605694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f6f55-9b9b-4b6e-9f2b-c8ceace94456 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:19.610507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:19.611311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:19.611599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:19.611879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] PATH_INFO: `/v3/projects/b4d50fa983ee42b5a948a684ea509690` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:19.625032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4d50fa983ee42b5a948a684ea509690)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:19.651566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:19.653089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 681/1362] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:19 2022] GET /identity/v3/projects/b4d50fa983ee42b5a948a684ea509690 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:11:19.659834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:19.668445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2173-5bd0-469f-8f39-e80381696df5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:19.673123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:19.673699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:19.674020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:19.674305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:19.675022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] RBAC: Adding query filter params (scope.project.id=b4d50fa983ee42b5a948a684ea509690) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:19.675324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:19.700924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a06ee-2782-4bf6-9d66-3c85636d7216 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:19.706888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 682/1363] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:19 2022] GET /identity/v3/role_assignments?scope.project.id=b4d50fa983ee42b5a948a684ea509690 => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:19.712561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:19.722021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa07e4-e34b-4e8f-b2a2-e9c9b8609840 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:19.726188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:19.726976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:19.727267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:19.727553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] PATH_INFO: `/v3/users/8570d44dd6234af7b66de40219c0d4ca` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:19.746286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] RBAC: Authorizing `identity:get_user(user_id=8570d44dd6234af7b66de40219c0d4ca)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:19.772317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ec90-5e08-49b6-838e-7a460110c247 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:19.773828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 682/1364] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:19 2022] GET /identity/v3/users/8570d44dd6234af7b66de40219c0d4ca => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:21.806350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8f7a-2d16-4897-bfca-dec2661e922c None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:21.806909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8f7a-2d16-4897-bfca-dec2661e922c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:21.806909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8f7a-2d16-4897-bfca-dec2661e922c None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:21.808582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 683/1365] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:21.814316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:21.814720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:21.814887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:21.837488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:21.838643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:21.845500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 683/1366] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:21.867062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8f7a-2d16-4897-bfca-dec2661e922c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:21.879360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8f7a-2d16-4897-bfca-dec2661e922c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:21.883396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:21.884175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:21.884464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:21.884760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] PATH_INFO: `/v3/projects/c8792ac1fff2499693ec24addb914ca7` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:21.899302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] RBAC: Authorizing `identity:get_project(project_id=c8792ac1fff2499693ec24addb914ca7)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:21.925969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:21.927562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 684/1367] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:21 2022] GET /identity/v3/projects/c8792ac1fff2499693ec24addb914ca7 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:21.933567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:21.942986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ef6bb-f7ae-460b-adf5-c070400c99ef None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:21.947122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:21.947695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:21.947980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:21.948259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:21.948972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] RBAC: Adding query filter params (scope.project.id=c8792ac1fff2499693ec24addb914ca7) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:21.949270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:21.974824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:21.981737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 684/1368] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:21 2022] GET /identity/v3/role_assignments?scope.project.id=c8792ac1fff2499693ec24addb914ca7 => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:11:21.988076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:21.997477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc894-7b63-4cc2-9496-c6b0da9e7c5c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:22.002369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:22.003151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:22.003439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:22.003714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:22.023096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:22.048843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01983b07-7381-4b3d-a842-8b9242b10562 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:22.050406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 685/1369] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:21 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:22.056208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:22.066374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8015-778f-41cd-b05a-2f50e010e006 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:22.070497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:22.071307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:22.071596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:22.071878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] PATH_INFO: `/v3/users/cf57ff3f8bf6405fb95452e508235caa` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:22.072966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf57ff3f8bf6405fb95452e508235caa)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:22.098522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b7d-b492-4200-984f-c1fd0b841045 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:22.100014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 685/1370] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:22 2022] GET /identity/v3/users/cf57ff3f8bf6405fb95452e508235caa => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:24.174293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ee9f-7dad-4b90-9f43-f34e7bfb616f None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:24.174848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ee9f-7dad-4b90-9f43-f34e7bfb616f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:24.174848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ee9f-7dad-4b90-9f43-f34e7bfb616f None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:24.176524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 686/1371] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:24.181707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:24.182116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:24.182338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:24.204657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:24.205777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:24.212575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 686/1372] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:24.237524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6ee9f-7dad-4b90-9f43-f34e7bfb616f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:24.251433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6ee9f-7dad-4b90-9f43-f34e7bfb616f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:24.255460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:24.256231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:24.256520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:24.256796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] PATH_INFO: `/v3/projects/ef5c414ee7ba4731b0ab94c015a31761` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:24.269637 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef5c414ee7ba4731b0ab94c015a31761)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:24.295340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:24.296978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 687/1373] 10.222.0.11 () {56 vars in 1207 bytes} [Wed Apr 6 10:11:24 2022] GET /identity/v3/projects/ef5c414ee7ba4731b0ab94c015a31761 => generated 312 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:24.303144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:24.311998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fa7e-8b6d-4237-8509-2709a79f2787 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:24.316353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:24.318168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:24.318168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:24.318168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:24.318447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] RBAC: Adding query filter params (scope.project.id=ef5c414ee7ba4731b0ab94c015a31761) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:11:24.318651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:24.345757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4c6b-5928-4aa3-847f-2a3e28d54667 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:24.351312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 687/1374] 10.222.0.11 () {56 vars in 1231 bytes} [Wed Apr 6 10:11:24 2022] GET /identity/v3/role_assignments?scope.project.id=ef5c414ee7ba4731b0ab94c015a31761 => generated 526 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:24.357108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:24.366710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed828f0-e310-4395-9c1b-b71bbc6b90c1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:24.370922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:24.371701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:24.371986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:24.372261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] PATH_INFO: `/v3/users/eb0548be2b5b414793600ed4b598db29` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:24.373322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb0548be2b5b414793600ed4b598db29)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:24.399099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c4361-bc92-45c9-997b-eb8e09cdcf05 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:24.400541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 688/1375] 10.222.0.11 () {56 vars in 1198 bytes} [Wed Apr 6 10:11:24 2022] GET /identity/v3/users/eb0548be2b5b414793600ed4b598db29 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:11:29.120117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37af3f-912e-4c2d-b7f6-72f90ae40ce6 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:29.120769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37af3f-912e-4c2d-b7f6-72f90ae40ce6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:29.120769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37af3f-912e-4c2d-b7f6-72f90ae40ce6 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:29.122372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 688/1376] 10.222.0.11 () {54 vars in 918 bytes} [Wed Apr 6 10:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:29.127804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e0ccc-d66c-44af-96a2-2f2df3bda162 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:29.128436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e0ccc-d66c-44af-96a2-2f2df3bda162 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:29.128436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e0ccc-d66c-44af-96a2-2f2df3bda162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:29.151229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-044e0ccc-d66c-44af-96a2-2f2df3bda162 None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:29.152348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-044e0ccc-d66c-44af-96a2-2f2df3bda162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:29.161095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 689/1377] 10.222.0.11 () {58 vars in 1015 bytes} [Wed Apr 6 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:29.220991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95111b8-6fb0-49df-a7ae-73757fca69bf None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:29.221421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95111b8-6fb0-49df-a7ae-73757fca69bf None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:29.221847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95111b8-6fb0-49df-a7ae-73757fca69bf None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:29.223953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 689/1378] 10.222.0.11 () {54 vars in 918 bytes} [Wed Apr 6 10:11:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:29.229122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bde72-c0b8-4867-a39e-efc7c46f80de None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:29.229422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bde72-c0b8-4867-a39e-efc7c46f80de None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:29.229710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bde72-c0b8-4867-a39e-efc7c46f80de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:29.252433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f56bde72-c0b8-4867-a39e-efc7c46f80de None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:29.253494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f56bde72-c0b8-4867-a39e-efc7c46f80de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:29.261518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 690/1379] 10.222.0.11 () {58 vars in 1015 bytes} [Wed Apr 6 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:11:31.618640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e462-5a20-4684-a25a-29d1f28ec3bc None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:31.619189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e462-5a20-4684-a25a-29d1f28ec3bc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:31.619298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e462-5a20-4684-a25a-29d1f28ec3bc None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:31.620910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:31.626063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b632b-3e80-4924-8acc-834b906a8662 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:31.626498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b632b-3e80-4924-8acc-834b906a8662 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:31.626633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b632b-3e80-4924-8acc-834b906a8662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:31.648785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-493b632b-3e80-4924-8acc-834b906a8662 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:31.649841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-493b632b-3e80-4924-8acc-834b906a8662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:31.657608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:31.743433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e462-5a20-4684-a25a-29d1f28ec3bc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:31.756987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e462-5a20-4684-a25a-29d1f28ec3bc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:31.761718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:31.762310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:31.762600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:31.762876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:31.771496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:31.797941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c2a08-3fef-4eec-b1a4-e0e381ab3957 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:31.807018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 691/1382] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:33.218207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcf24-dcc9-474c-9310-bf7019e1e07e None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:33.219491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcf24-dcc9-474c-9310-bf7019e1e07e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:33.219491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcf24-dcc9-474c-9310-bf7019e1e07e None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:33.221010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:33.225749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be799fd-94d1-4fdf-a52e-fd9b7f57ec25 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:33.226225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be799fd-94d1-4fdf-a52e-fd9b7f57ec25 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:33.226363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be799fd-94d1-4fdf-a52e-fd9b7f57ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:33.248406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6be799fd-94d1-4fdf-a52e-fd9b7f57ec25 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:33.249467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6be799fd-94d1-4fdf-a52e-fd9b7f57ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:33.256817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:33.403121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefcf24-dcc9-474c-9310-bf7019e1e07e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:33.417588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefcf24-dcc9-474c-9310-bf7019e1e07e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:33.422597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:33.423157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:33.423439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:33.423715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:33.431363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:33.456740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fe2d4-6478-4842-b0e9-077d744437ec service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:33.465509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 693/1385] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:34.889466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45223a-cd74-4264-94b4-fbc8a714848d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:34.890035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45223a-cd74-4264-94b4-fbc8a714848d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:34.890155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45223a-cd74-4264-94b4-fbc8a714848d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:34.892004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:34.896742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33634-44ac-4090-9bd7-854e219993e9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:34.897185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33634-44ac-4090-9bd7-854e219993e9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:34.897353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33634-44ac-4090-9bd7-854e219993e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:34.919602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d2a33634-44ac-4090-9bd7-854e219993e9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:34.920734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d2a33634-44ac-4090-9bd7-854e219993e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:34.928103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:35.079203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45223a-cd74-4264-94b4-fbc8a714848d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:35.092576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45223a-cd74-4264-94b4-fbc8a714848d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:35.098110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:35.098678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:35.098972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:35.099255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:35.107035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:35.132649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a1eb-1e62-4380-b0a5-428889562690 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:35.141640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 694/1388] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:11:36.574749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9e5b5-ac02-4b24-9c7a-0771a74d12b5 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:36.575326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9e5b5-ac02-4b24-9c7a-0771a74d12b5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:36.575326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9e5b5-ac02-4b24-9c7a-0771a74d12b5 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:36.577023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:36.582053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81b47-cc7d-422d-b4ee-1937441dd183 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:36.582522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81b47-cc7d-422d-b4ee-1937441dd183 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:36.582659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81b47-cc7d-422d-b4ee-1937441dd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:36.605013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3ff81b47-cc7d-422d-b4ee-1937441dd183 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:36.606170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3ff81b47-cc7d-422d-b4ee-1937441dd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:36.613585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:36.760928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9e5b5-ac02-4b24-9c7a-0771a74d12b5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:36.774490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9e5b5-ac02-4b24-9c7a-0771a74d12b5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:36.779201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:36.780031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:36.780313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:36.781155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:36.789258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:36.815013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184338f0-1d55-4c7f-915f-e97925f11415 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:36.824634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 696/1391] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:38.309261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9c80-2b5a-42c3-8d8f-4939befc130a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:38.309821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9c80-2b5a-42c3-8d8f-4939befc130a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:38.310031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9c80-2b5a-42c3-8d8f-4939befc130a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:38.311721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:38.316777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1e95-c37b-4d1c-891f-89888e66cfe5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:38.317220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1e95-c37b-4d1c-891f-89888e66cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:38.317339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1e95-c37b-4d1c-891f-89888e66cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:38.339614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d7ba1e95-c37b-4d1c-891f-89888e66cfe5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:38.340729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d7ba1e95-c37b-4d1c-891f-89888e66cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:38.348431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:38.500839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9c80-2b5a-42c3-8d8f-4939befc130a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:38.514850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9c80-2b5a-42c3-8d8f-4939befc130a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:38.520525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:38.521101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:38.521390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:38.521671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:38.529862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:38.555397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a59ef6-1fca-4022-80c8-4b736019ce26 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:38.564574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 697/1394] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:40.008174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935d36-329b-47fa-8c97-ef28286553a6 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:40.008608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935d36-329b-47fa-8c97-ef28286553a6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:40.008735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935d36-329b-47fa-8c97-ef28286553a6 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:40.010498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:40.015506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddeec8-36d4-4f7d-8070-d64c829de737 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:40.016542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddeec8-36d4-4f7d-8070-d64c829de737 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:40.016640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddeec8-36d4-4f7d-8070-d64c829de737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:40.039595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1bddeec8-36d4-4f7d-8070-d64c829de737 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:40.040726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1bddeec8-36d4-4f7d-8070-d64c829de737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:40.047958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:11:40.197142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935d36-329b-47fa-8c97-ef28286553a6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:40.211232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935d36-329b-47fa-8c97-ef28286553a6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:40.216028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:40.216598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:40.216883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:40.217164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:40.227836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:40.255635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee4223-3fa7-422b-bb83-dd4f944b3e03 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:40.265005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 699/1397] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:41.689487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49db10-707b-45f7-9edd-9fb3f89229e3 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:41.690055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49db10-707b-45f7-9edd-9fb3f89229e3 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:41.690055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49db10-707b-45f7-9edd-9fb3f89229e3 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:41.691667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:41.696372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4af8a7-581f-42f0-8df5-584c589b31e1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:41.696782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4af8a7-581f-42f0-8df5-584c589b31e1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:41.696957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4af8a7-581f-42f0-8df5-584c589b31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:41.718795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7e4af8a7-581f-42f0-8df5-584c589b31e1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:41.720472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7e4af8a7-581f-42f0-8df5-584c589b31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:41.727302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:41.876846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49db10-707b-45f7-9edd-9fb3f89229e3 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:41.890117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49db10-707b-45f7-9edd-9fb3f89229e3 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:41.895195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:41.895764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:41.896077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:41.896375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:41.904113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:41.931377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5f231-4a6f-400d-9bd0-5540c5629ae1 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:41.940754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 700/1400] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:43.383365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97f67-6b3b-4aca-83d6-4891e2bed213 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:43.383892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97f67-6b3b-4aca-83d6-4891e2bed213 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:43.383892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97f67-6b3b-4aca-83d6-4891e2bed213 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:43.385531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:43.390361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ce47-71c8-49ce-8699-8b3d28a88b4c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:43.390841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ce47-71c8-49ce-8699-8b3d28a88b4c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:43.390948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ce47-71c8-49ce-8699-8b3d28a88b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:43.414030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ab25ce47-71c8-49ce-8699-8b3d28a88b4c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:43.415167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ab25ce47-71c8-49ce-8699-8b3d28a88b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:43.422618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:43.570159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc97f67-6b3b-4aca-83d6-4891e2bed213 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:43.583926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc97f67-6b3b-4aca-83d6-4891e2bed213 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:43.588936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:43.589505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:43.589789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:43.590095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:43.598935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:43.625046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9226-01e5-48a0-9d96-065f343809ff service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:43.635416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 702/1403] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:45.128469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d701c-4bbb-4d63-a626-eb638979ec3c None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:45.129035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d701c-4bbb-4d63-a626-eb638979ec3c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:45.129035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d701c-4bbb-4d63-a626-eb638979ec3c None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:45.130767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:45.135480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60254c3-d6bf-4dde-9830-213b948124f5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:45.135868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60254c3-d6bf-4dde-9830-213b948124f5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:45.136028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60254c3-d6bf-4dde-9830-213b948124f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:45.159728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b60254c3-d6bf-4dde-9830-213b948124f5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:45.160872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b60254c3-d6bf-4dde-9830-213b948124f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:45.168333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:45.318209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d701c-4bbb-4d63-a626-eb638979ec3c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:45.331816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d701c-4bbb-4d63-a626-eb638979ec3c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:45.336603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:45.337170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:45.337457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:45.337739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:45.345461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:45.370914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b836416-f5ee-47b9-bd6f-e8d4005746fe service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:45.379784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 703/1406] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:47.355570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db991a-cf75-411a-a8e6-40314edc4dcf None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:47.356175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db991a-cf75-411a-a8e6-40314edc4dcf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:47.356175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db991a-cf75-411a-a8e6-40314edc4dcf None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:47.357814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:47.363704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9280-f45f-415a-8a67-1ea0e581ab6b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:47.364149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9280-f45f-415a-8a67-1ea0e581ab6b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:47.364313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9280-f45f-415a-8a67-1ea0e581ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:47.388363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6bcc9280-f45f-415a-8a67-1ea0e581ab6b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:47.389522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6bcc9280-f45f-415a-8a67-1ea0e581ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:47.396783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:47.433842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db991a-cf75-411a-a8e6-40314edc4dcf None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:47.444698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db991a-cf75-411a-a8e6-40314edc4dcf None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:47.447915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:47.448475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:47.448759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:47.449036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:47.457759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:47.482187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9996eb-0c9c-4229-8682-2bf814a06d3a service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:47.491868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 705/1409] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:11:49.599449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9de1-b203-46cd-8873-239df9e7e202 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:49.600005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9de1-b203-46cd-8873-239df9e7e202 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:49.600005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9de1-b203-46cd-8873-239df9e7e202 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:49.601684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:11:49.606966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516dc-1a21-4f1a-af76-b3b79c72ba0f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:49.607364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516dc-1a21-4f1a-af76-b3b79c72ba0f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:49.607534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516dc-1a21-4f1a-af76-b3b79c72ba0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:49.630687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-245516dc-1a21-4f1a-af76-b3b79c72ba0f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:49.631813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-245516dc-1a21-4f1a-af76-b3b79c72ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:49.638605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:49.676104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb9de1-b203-46cd-8873-239df9e7e202 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:49.686364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb9de1-b203-46cd-8873-239df9e7e202 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:49.690415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:49.690979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:49.691267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:49.691548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:49.699992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:49.725030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37b4f-c6f3-4aef-b9b2-d4650491e785 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:49.733855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 706/1412] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:52.328886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122dca7-f00f-46a0-a27c-93e002d9019b None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:52.329416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122dca7-f00f-46a0-a27c-93e002d9019b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:52.329532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122dca7-f00f-46a0-a27c-93e002d9019b None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:52.331197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:52.336507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9932-5fe2-41ba-bfbb-f2aeefe9ab08 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:52.336927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9932-5fe2-41ba-bfbb-f2aeefe9ab08 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:52.337080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9932-5fe2-41ba-bfbb-f2aeefe9ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:52.360367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b0bb9932-5fe2-41ba-bfbb-f2aeefe9ab08 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:52.361520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b0bb9932-5fe2-41ba-bfbb-f2aeefe9ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:52.368467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:52.409512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122dca7-f00f-46a0-a27c-93e002d9019b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:52.419670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122dca7-f00f-46a0-a27c-93e002d9019b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:52.423825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:52.424401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:52.424694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:52.424978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:52.433590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:52.458169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3080dac-d1a6-4417-ad0f-b1d0fcefe3d5 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:52.467066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 708/1415] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:54.614699 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164d5-19d3-46b5-84c2-187acb5163a5 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:54.615224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164d5-19d3-46b5-84c2-187acb5163a5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:54.615224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164d5-19d3-46b5-84c2-187acb5163a5 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:54.616822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:54.622014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ec230-3713-4227-8034-1bfb9213840d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:54.622419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ec230-3713-4227-8034-1bfb9213840d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:54.622580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ec230-3713-4227-8034-1bfb9213840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:54.646310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b28ec230-3713-4227-8034-1bfb9213840d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:54.647433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b28ec230-3713-4227-8034-1bfb9213840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:54.654627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:54.699998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140164d5-19d3-46b5-84c2-187acb5163a5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:54.710865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140164d5-19d3-46b5-84c2-187acb5163a5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:54.714054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:54.714616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:54.714897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:54.715175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:54.723495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:54.747957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e4717-e345-42dc-96ff-ba1bbfa36d6e service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:54.757462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 709/1418] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:56.884602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31707e-6d0b-49cf-84a5-436aa63ab9bc None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:56.885198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31707e-6d0b-49cf-84a5-436aa63ab9bc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:56.885198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31707e-6d0b-49cf-84a5-436aa63ab9bc None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:56.886877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:56.892425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301545a4-b96d-4783-ae37-6228a78997f4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:56.892856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301545a4-b96d-4783-ae37-6228a78997f4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:56.893000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301545a4-b96d-4783-ae37-6228a78997f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:56.916128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-301545a4-b96d-4783-ae37-6228a78997f4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:56.917253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-301545a4-b96d-4783-ae37-6228a78997f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:56.924860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:11:56.962122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31707e-6d0b-49cf-84a5-436aa63ab9bc None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:56.973125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31707e-6d0b-49cf-84a5-436aa63ab9bc None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:56.976361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:56.976926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:56.977241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:56.977522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:56.986679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:57.011067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5a012-05d6-44ee-b87f-6b16939a2a00 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:57.020263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 711/1421] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:11:59.149477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b618-4170-4546-a53c-774828ed29cd None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:59.150102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b618-4170-4546-a53c-774828ed29cd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:59.150102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4b618-4170-4546-a53c-774828ed29cd None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:59.151719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:11:59.157136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74dbe7-91e1-40f8-b173-7e64fe077e76 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:59.157550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74dbe7-91e1-40f8-b173-7e64fe077e76 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:59.157705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74dbe7-91e1-40f8-b173-7e64fe077e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:59.180856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5d74dbe7-91e1-40f8-b173-7e64fe077e76 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:11:59.182015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5d74dbe7-91e1-40f8-b173-7e64fe077e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:11:59.189496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:11:59.227448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4b618-4170-4546-a53c-774828ed29cd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:11:59.237675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4b618-4170-4546-a53c-774828ed29cd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:11:59.240928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:11:59.241492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:11:59.241781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:11:59.242106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:11:59.251271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:11:59.276359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea278-53c8-47a3-beff-5ec26a70273b service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:11:59.285512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 712/1424] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:11:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:01.365580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde209c-4638-4672-b567-86754ef94189 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:01.366179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde209c-4638-4672-b567-86754ef94189 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:01.366179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde209c-4638-4672-b567-86754ef94189 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:01.367848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:01.373093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679edf-55b2-45e4-8e51-799d2bfd1d64 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:01.373509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679edf-55b2-45e4-8e51-799d2bfd1d64 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:01.373667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50679edf-55b2-45e4-8e51-799d2bfd1d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:01.395799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-50679edf-55b2-45e4-8e51-799d2bfd1d64 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:01.396932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-50679edf-55b2-45e4-8e51-799d2bfd1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:01.403732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:01.442041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde209c-4638-4672-b567-86754ef94189 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:01.452397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde209c-4638-4672-b567-86754ef94189 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:01.455737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:01.456296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:01.456581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:01.456858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:01.465417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:01.490888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b42aa-46f0-4e0e-92cb-8f2fb76b6622 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:01.500003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 714/1427] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:03.652257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c434a-8c89-44fe-819e-e728a8384efb None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:03.652828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c434a-8c89-44fe-819e-e728a8384efb None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:03.652828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c434a-8c89-44fe-819e-e728a8384efb None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:03.654789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:03.660429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707707-f5cc-4712-b9da-96bce7088156 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:03.660869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707707-f5cc-4712-b9da-96bce7088156 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:03.660979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707707-f5cc-4712-b9da-96bce7088156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:03.691020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-95707707-f5cc-4712-b9da-96bce7088156 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:03.691020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-95707707-f5cc-4712-b9da-96bce7088156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:03.692427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:12:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:03.729424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c434a-8c89-44fe-819e-e728a8384efb None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:03.739929 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c434a-8c89-44fe-819e-e728a8384efb None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:03.743159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:03.743725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:03.744010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:03.744290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:03.753168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:03.778124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71304f3-84b0-4159-aaed-807d9e631a0d service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:03.791442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 715/1430] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:05.804806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df8245-063d-4a1a-a4ad-3caae3216c1a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:05.805355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df8245-063d-4a1a-a4ad-3caae3216c1a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:05.805355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df8245-063d-4a1a-a4ad-3caae3216c1a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:05.807074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:05.812572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656305f-3eb5-44f9-be67-d41a68c2c689 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:05.812982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656305f-3eb5-44f9-be67-d41a68c2c689 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:05.813134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656305f-3eb5-44f9-be67-d41a68c2c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:05.835004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6656305f-3eb5-44f9-be67-d41a68c2c689 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:05.836163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6656305f-3eb5-44f9-be67-d41a68c2c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:05.843053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:12:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:05.879522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df8245-063d-4a1a-a4ad-3caae3216c1a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:05.889948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df8245-063d-4a1a-a4ad-3caae3216c1a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:05.894048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:05.894646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:05.894962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:05.895241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:05.903840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:05.929405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be80b-b7e1-4213-97b7-ab3159ffe738 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:05.938614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 717/1433] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:08.013094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc414-196c-4fba-b8de-d54fdeb2763a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:08.013551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc414-196c-4fba-b8de-d54fdeb2763a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:08.013649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc414-196c-4fba-b8de-d54fdeb2763a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:08.015509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:08.020647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755ce62-b019-4f49-bd46-62db30877aff None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:08.021055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755ce62-b019-4f49-bd46-62db30877aff None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:08.021205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755ce62-b019-4f49-bd46-62db30877aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:08.043807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d755ce62-b019-4f49-bd46-62db30877aff None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:08.044926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d755ce62-b019-4f49-bd46-62db30877aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:08.052802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:12:08.087461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bc414-196c-4fba-b8de-d54fdeb2763a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:08.098748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bc414-196c-4fba-b8de-d54fdeb2763a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:08.101916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:08.102506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:08.102791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:08.103070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:08.112527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:08.137874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f530-b3cb-42fe-8ed0-9a11c1e445d9 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:08.147858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 718/1436] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:12:19.958348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e444-c6cb-4e8b-8f3e-fbf218d97a19 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:19.958903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e444-c6cb-4e8b-8f3e-fbf218d97a19 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:19.959017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e444-c6cb-4e8b-8f3e-fbf218d97a19 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:19.960619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 719/1437] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:19.965910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d13c-86d3-45fc-bf88-73531df69073 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:19.966374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d13c-86d3-45fc-bf88-73531df69073 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:19.966517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d13c-86d3-45fc-bf88-73531df69073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:19.989817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7227d13c-86d3-45fc-bf88-73531df69073 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:19.990972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7227d13c-86d3-45fc-bf88-73531df69073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:19.998218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 719/1438] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:12:20.042783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e444-c6cb-4e8b-8f3e-fbf218d97a19 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:20.053656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e444-c6cb-4e8b-8f3e-fbf218d97a19 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:20.056945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:20.057507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:20.057792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:20.058107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:20.066709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:20.090925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276f385-2dd0-4b98-80d1-b7523332f823 service glance] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:20.100636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 720/1439] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:22.162256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1cbbb-c90d-44a7-861f-da155c80359a None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:22.162811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1cbbb-c90d-44a7-861f-da155c80359a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:22.162917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1cbbb-c90d-44a7-861f-da155c80359a None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:22.164622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 720/1440] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:22.169989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd0de-39ce-4495-8901-c7353ff67f56 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:22.170428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd0de-39ce-4495-8901-c7353ff67f56 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:22.170556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efd0de-39ce-4495-8901-c7353ff67f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:22.192703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-21efd0de-39ce-4495-8901-c7353ff67f56 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:22.193831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-21efd0de-39ce-4495-8901-c7353ff67f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:22.200617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 721/1441] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:22.223636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1cbbb-c90d-44a7-861f-da155c80359a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:22.235427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1cbbb-c90d-44a7-861f-da155c80359a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:22.239411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:22.239964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:22.240247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:22.240523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:22.241210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:22.267281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c255d-f7d0-4f0c-a19d-cfa38686a38c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:22.282199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 721/1442] 10.222.0.11 () {56 vars in 1108 bytes} [Wed Apr 6 10:12:22 2022] GET /identity/v3/projects => generated 2553 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:12:23.851603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616bea-512c-466a-867c-f9a178c9abb2 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:23.852149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616bea-512c-466a-867c-f9a178c9abb2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:23.852149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97616bea-512c-466a-867c-f9a178c9abb2 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:23.853898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 722/1443] 10.222.0.11 () {54 vars in 911 bytes} [Wed Apr 6 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:23.858567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8ff4-8235-474c-a93f-672776def90d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:23.858567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8ff4-8235-474c-a93f-672776def90d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:23.859391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8ff4-8235-474c-a93f-672776def90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:23.881134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-008a8ff4-8235-474c-a93f-672776def90d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:23.882292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-008a8ff4-8235-474c-a93f-672776def90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:23.889092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 722/1444] 10.222.0.11 () {58 vars in 1008 bytes} [Wed Apr 6 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:24.037457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97616bea-512c-466a-867c-f9a178c9abb2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:24.051219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97616bea-512c-466a-867c-f9a178c9abb2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:24.056026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:24.056590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:24.056878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:24.057157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:24.065487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:24.090716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4921-5d0c-4621-8ef0-7e2311224892 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:24.099477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 723/1445] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:26.131593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae456-3c2d-4cd6-8bda-6d3396180db7 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:26.132146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae456-3c2d-4cd6-8bda-6d3396180db7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:26.132146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae456-3c2d-4cd6-8bda-6d3396180db7 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:26.133835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 723/1446] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:26.139038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9b829-06a0-4aba-9de1-e77b9698bb15 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:26.139520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9b829-06a0-4aba-9de1-e77b9698bb15 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:26.140752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9b829-06a0-4aba-9de1-e77b9698bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:26.162529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b5d9b829-06a0-4aba-9de1-e77b9698bb15 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:26.163660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b5d9b829-06a0-4aba-9de1-e77b9698bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:26.170581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 724/1447] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:26.206005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ae456-3c2d-4cd6-8bda-6d3396180db7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:26.216178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ae456-3c2d-4cd6-8bda-6d3396180db7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:26.220021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:26.220585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:26.220873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:26.221152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:26.229605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:26.255649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef216b5-94b5-4224-b208-19ae24173515 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:26.264678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 724/1448] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:28.304903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ef-a5d6-4a40-b630-0dec46ad161a None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:28.305464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ef-a5d6-4a40-b630-0dec46ad161a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:28.305572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ef-a5d6-4a40-b630-0dec46ad161a None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:28.307204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 725/1449] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:28.313500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a715-f508-4d76-b79e-0815c1cbedad None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:28.313951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a715-f508-4d76-b79e-0815c1cbedad None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:28.314080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a715-f508-4d76-b79e-0815c1cbedad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:28.336747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-dab6a715-f508-4d76-b79e-0815c1cbedad None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:28.337874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dab6a715-f508-4d76-b79e-0815c1cbedad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:28.344977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 725/1450] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:28.382846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e019ef-a5d6-4a40-b630-0dec46ad161a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:28.393537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e019ef-a5d6-4a40-b630-0dec46ad161a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:28.396682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:28.397239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:28.397536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:28.397797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:28.406632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:28.431049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1180c-6ecc-41a5-9695-c22440fd1c5b service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:28.440489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 726/1451] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:30.562221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf198-de42-4bf6-b1df-c33fabfe99ac None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:30.562840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf198-de42-4bf6-b1df-c33fabfe99ac None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:30.562952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf198-de42-4bf6-b1df-c33fabfe99ac None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:30.564594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 726/1452] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:30.569903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f5a2-389e-46ef-89d9-5fa9959f0d3a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:30.570393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f5a2-389e-46ef-89d9-5fa9959f0d3a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:30.570504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f5a2-389e-46ef-89d9-5fa9959f0d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:30.593855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3ba3f5a2-389e-46ef-89d9-5fa9959f0d3a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:30.595040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3ba3f5a2-389e-46ef-89d9-5fa9959f0d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:30.602077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 727/1453] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:30.641679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cf198-de42-4bf6-b1df-c33fabfe99ac None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:30.651870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cf198-de42-4bf6-b1df-c33fabfe99ac None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:30.655738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:30.656317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:30.656607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:30.656890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:30.665560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:30.691163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2126991-b491-4c80-b229-46a939dfc0e9 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:30.700118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 727/1454] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:12:33.151757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa252a0-3a93-448a-80ca-77a6d7d5ebb5 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:33.152313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa252a0-3a93-448a-80ca-77a6d7d5ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:33.152313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa252a0-3a93-448a-80ca-77a6d7d5ebb5 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:33.154315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 728/1455] 10.222.0.11 () {54 vars in 926 bytes} [Wed Apr 6 10:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:12:33.160557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023aaf9-ec02-47fd-8d93-6dceeac8590b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:33.161000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023aaf9-ec02-47fd-8d93-6dceeac8590b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:33.161133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023aaf9-ec02-47fd-8d93-6dceeac8590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:33.183104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8023aaf9-ec02-47fd-8d93-6dceeac8590b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:12:33.184230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8023aaf9-ec02-47fd-8d93-6dceeac8590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:12:33.191182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 728/1456] 10.222.0.11 () {58 vars in 1023 bytes} [Wed Apr 6 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:12:33.229921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa252a0-3a93-448a-80ca-77a6d7d5ebb5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:12:33.240796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa252a0-3a93-448a-80ca-77a6d7d5ebb5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:12:33.244221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:12:33.244791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:12:33.245105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:12:33.245384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:12:33.254117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:12:33.279132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbdb3b-97f3-403f-bd58-8f218a9f1ed8 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:12:33.288569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 729/1457] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:14:01.069537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.070112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.070216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.092500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:14:01.093624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:01.100468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 729/1458] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:14:01.108948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.109428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.109534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.132641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:14:01.133755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:01.141484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 730/1459] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:14:01.145996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.155676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800cbb2-f561-4f56-b43c-c2614cff5466 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.159717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.160293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.160577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.160856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.161573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:14:01.161871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:01.188131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:01.205650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 730/1460] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:14:01.213636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.222963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a023092-1385-4768-90f5-2c708b4cfda0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.227234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.227813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.228106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.228431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.229068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:01.254761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:01.335586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 731/1461] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:14:01 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:14:01.340324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.349752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc998e3-f5dd-4147-b7f1-7b6a02374f34 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.412202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.412851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.413135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.413410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.414069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:01.440218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:01.597568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 731/1462] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:14:01 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:14:01.601822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.612078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00a26-0630-47bc-afe4-62293d95c806 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.616177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.616768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.617105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.617344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.618079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:01.643749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea61ae-032d-4477-9c87-f382e5388b60 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:01.654638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 732/1463] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:14:01.658817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.668378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6bb54-770f-4bd9-b6ec-aa33ab58e600 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.672499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.673304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.673591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.673872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] PATH_INFO: `/v3/projects/c576472ed4544aecbe12ef3f68d240a9/users/df40acfa7e544fa791987a808e641f65/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.693158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c576472ed4544aecbe12ef3f68d240a9, user_id=df40acfa7e544fa791987a808e641f65, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:01.719879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:01.780238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 732/1464] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:14:01 2022] PUT /identity/v3/projects/c576472ed4544aecbe12ef3f68d240a9/users/df40acfa7e544fa791987a808e641f65/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:14:01.791306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072dfe5-5e70-4429-ba95-fbc647812b29 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.791833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072dfe5-5e70-4429-ba95-fbc647812b29 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.791948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072dfe5-5e70-4429-ba95-fbc647812b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:01.828307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2072dfe5-5e70-4429-ba95-fbc647812b29 None None] MFA Rules not processed for user `df40acfa7e544fa791987a808e641f65`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:14:01.829423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2072dfe5-5e70-4429-ba95-fbc647812b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:01.898830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 733/1465] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:14:01.910332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:01.985687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d58e3-75a0-428d-8003-b5e34f0a8948 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:01.990569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:01.991143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:01.991428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:01.991704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:02.000458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:02.026129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:02.035295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 733/1466] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:14:02.111198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfc79-5b7e-47b8-9709-4e5585a0dede None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:02.111630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfc79-5b7e-47b8-9709-4e5585a0dede None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:02.111864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfc79-5b7e-47b8-9709-4e5585a0dede None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:02.113471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 734/1467] 10.222.0.11 () {52 vars in 829 bytes} [Wed Apr 6 10:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:14:02.116938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:02.184122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a56767-9d97-4184-8b2f-033a8f907269 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:02.188464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:02.189265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:02.189555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:02.189838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] PATH_INFO: `/v3/users/df40acfa7e544fa791987a808e641f65` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:02.190947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df40acfa7e544fa791987a808e641f65)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:02.220207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 10:14:02.220207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 10:14:02.220207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 10:14:02.221492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:02.406865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df40acfa7e544fa791987a808e641f65'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:02.458930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df40acfa7e544fa791987a808e641f65'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:02.468853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df40acfa7e544fa791987a808e641f65'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:02.485250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df40acfa7e544fa791987a808e641f65'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:02.485894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df40acfa7e544fa791987a808e641f65'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:02.491883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 734/1468] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:14:02 2022] DELETE /identity/v3/users/df40acfa7e544fa791987a808e641f65 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:14:02.497066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:02.497362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:02.497648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:02.520388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:14:02.521511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:02.595604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 735/1469] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:14:02.606347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:02.608227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:02.672764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb836-995e-459e-92e5-a62336153d85 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:02.675968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:02.676538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:02.676822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:02.677099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:02.686441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:02.710968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae9e3-b9f9-4aa4-9b56-2ca2fc9af14f service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:02.720337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 735/1470] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:14:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:14:03.224817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:14:03.226295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:14:03.237499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d3be8-8401-41c1-b9c6-2c620c56ed72 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:14:03.241659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:14:03.242481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:14:03.242768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:14:03.243061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] PATH_INFO: `/v3/projects/c576472ed4544aecbe12ef3f68d240a9` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:14:03.244156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c576472ed4544aecbe12ef3f68d240a9)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:14:03.268583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 10:14:03.268583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 10:14:03.268583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 10:14:03.269763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:14:03.376933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c576472ed4544aecbe12ef3f68d240a9', 'request_id': 'req-f2627905-b9cf-430c-9ad4-5f67679c0065'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:03.388359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c576472ed4544aecbe12ef3f68d240a9', 'request_id': 'req-f2627905-b9cf-430c-9ad4-5f67679c0065'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:03.393261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c576472ed4544aecbe12ef3f68d240a9', 'request_id': 'req-f2627905-b9cf-430c-9ad4-5f67679c0065'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:03.458552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] The token cache is being invalidate because project c576472ed4544aecbe12ef3f68d240a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:14:03.458834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:03.459419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f2627905-b9cf-430c-9ad4-5f67679c0065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:14:03.460956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 736/1471] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:14:03 2022] DELETE /identity/v3/projects/c576472ed4544aecbe12ef3f68d240a9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:15:43.839697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25e4e3-4ed7-41d8-95d7-aa9937d2f076 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:43.840301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25e4e3-4ed7-41d8-95d7-aa9937d2f076 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:43.840301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25e4e3-4ed7-41d8-95d7-aa9937d2f076 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:43.842144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:15:43.847838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751e87-519a-47e2-a991-e4107a48eddf None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:43.848299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751e87-519a-47e2-a991-e4107a48eddf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:43.848399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751e87-519a-47e2-a991-e4107a48eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:43.871703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6d751e87-519a-47e2-a991-e4107a48eddf None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:43.872848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6d751e87-519a-47e2-a991-e4107a48eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:43.942388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:44.082443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:44.082736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:44.083020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] PATH_INFO: `/v3` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:44.084344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 737/1474] 10.222.0.61 () {54 vars in 925 bytes} [Wed Apr 6 10:15:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:15:44.090565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ecb5-82bb-468e-9ba5-629956ca19ce None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:44.090802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ecb5-82bb-468e-9ba5-629956ca19ce None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:44.091088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015ecb5-82bb-468e-9ba5-629956ca19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:44.110494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:15:44.112061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:44.114656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e015ecb5-82bb-468e-9ba5-629956ca19ce None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:44.115770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e015ecb5-82bb-468e-9ba5-629956ca19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:44.184819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 738/1475] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Apr 6 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:44.193670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0c24-974a-476f-96a8-18d903e6c59c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:15:44.198874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:15:44.199591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:44.199887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:44.200179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:44.208021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:15:44.234147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9d64-a1e1-423c-8116-523f4eab3901 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:15:44.243992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 738/1476] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:15:45.610400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4530d-bc72-45d4-b2de-f687dcea00e9 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:45.611030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4530d-bc72-45d4-b2de-f687dcea00e9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:45.611030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4530d-bc72-45d4-b2de-f687dcea00e9 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:45.612656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:15:45.617536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcf4a-c60d-41f2-8af5-a6e5d6ce55a2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:45.618512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcf4a-c60d-41f2-8af5-a6e5d6ce55a2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:45.619232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcf4a-c60d-41f2-8af5-a6e5d6ce55a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:45.642962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ba4bcf4a-c60d-41f2-8af5-a6e5d6ce55a2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:45.644099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ba4bcf4a-c60d-41f2-8af5-a6e5d6ce55a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:45.651992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:45.814334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4530d-bc72-45d4-b2de-f687dcea00e9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:15:45.829389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4530d-bc72-45d4-b2de-f687dcea00e9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:15:45.834416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:15:45.834988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:45.835292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:45.835681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:45.844257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:15:45.870350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7fbad-dcfe-4f29-8d11-08ec820b7a00 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:15:45.879246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 740/1479] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:15:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:15:48.022099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36a02-2256-4c30-b6a6-f6ccc76300c3 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:48.022666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36a02-2256-4c30-b6a6-f6ccc76300c3 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:48.022805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36a02-2256-4c30-b6a6-f6ccc76300c3 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:48.025450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 740/1480] 10.222.0.11 () {54 vars in 960 bytes} [Wed Apr 6 10:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:15:48.034353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a95e-8f4d-4fe5-8883-ed2ec9194e40 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:48.034826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a95e-8f4d-4fe5-8883-ed2ec9194e40 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:48.034935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5a95e-8f4d-4fe5-8883-ed2ec9194e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:48.066435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-bef5a95e-8f4d-4fe5-8883-ed2ec9194e40 None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:48.067568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-bef5a95e-8f4d-4fe5-8883-ed2ec9194e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:48.075776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 741/1481] 10.222.0.11 () {58 vars in 1057 bytes} [Wed Apr 6 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:48.089698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c36a02-2256-4c30-b6a6-f6ccc76300c3 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:15:48.102903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c36a02-2256-4c30-b6a6-f6ccc76300c3 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:15:48.107322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:15:48.107894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:48.108183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:48.108465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:48.116880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:15:48.143024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63722c-417e-4e72-9dfd-939e0fba8317 service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:15:48.153982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 741/1482] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:15:57.689963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727599b-fb24-4f3a-a1fd-34a1d1e4e905 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:57.690525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727599b-fb24-4f3a-a1fd-34a1d1e4e905 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:57.690525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727599b-fb24-4f3a-a1fd-34a1d1e4e905 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:57.692166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:15:57.697493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac304a7-5364-43af-9ce7-67023a5b66db None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:57.697903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac304a7-5364-43af-9ce7-67023a5b66db None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:57.698086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac304a7-5364-43af-9ce7-67023a5b66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:57.720993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-cac304a7-5364-43af-9ce7-67023a5b66db None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:57.722198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-cac304a7-5364-43af-9ce7-67023a5b66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:57.729343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:57.877857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727599b-fb24-4f3a-a1fd-34a1d1e4e905 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:15:57.891434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727599b-fb24-4f3a-a1fd-34a1d1e4e905 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:15:57.896273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:15:57.896818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:57.897104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:57.897384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:57.905650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:15:57.931236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c575cd-9abd-49d0-a50c-9ab71c247029 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:15:57.940142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 743/1485] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:15:59.324136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323d7b-d786-4364-866e-4d7c2db0eeae None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:59.324700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323d7b-d786-4364-866e-4d7c2db0eeae None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:59.324700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323d7b-d786-4364-866e-4d7c2db0eeae None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:59.326383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 10:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:15:59.330995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6109e-b09b-4286-ba13-7de43c17306d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:59.331441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6109e-b09b-4286-ba13-7de43c17306d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:59.331590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6109e-b09b-4286-ba13-7de43c17306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:59.354762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a7d6109e-b09b-4286-ba13-7de43c17306d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:15:59.355887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a7d6109e-b09b-4286-ba13-7de43c17306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:15:59.362916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:15:59.513587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c323d7b-d786-4364-866e-4d7c2db0eeae None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:15:59.528177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c323d7b-d786-4364-866e-4d7c2db0eeae None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:15:59.533080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:15:59.533652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:15:59.533960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:15:59.534247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:15:59.542526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:15:59.567224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aff648-ba5f-4124-8528-d73a1507d5d4 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:15:59.577043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 744/1488] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:16:03.636734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:03.637252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:03.637369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:03.639014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:16:03.644279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc236-913f-4cf1-a1bd-9798ddfd18b0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:03.644722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc236-913f-4cf1-a1bd-9798ddfd18b0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:03.644840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc236-913f-4cf1-a1bd-9798ddfd18b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:03.671502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b7dfc236-913f-4cf1-a1bd-9798ddfd18b0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:16:03.672647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b7dfc236-913f-4cf1-a1bd-9798ddfd18b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:03.681009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:16:03.717499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:16:03.719139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:03.783503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e994-38ea-43c2-8f8f-40dd130efdec None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:16:03.786928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:16:03.787511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:03.787800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:03.788084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:03.797571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:16:03.822839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c806f4-b709-4aed-822c-19b507651d68 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:16:03.831849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 746/1491] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:16:05.822897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51970-ef3f-4c0d-9e33-3fd87806de5c None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:05.823506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51970-ef3f-4c0d-9e33-3fd87806de5c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:05.823506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b51970-ef3f-4c0d-9e33-3fd87806de5c None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:05.825141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:16:05.830431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d174fe-cc8c-453c-b3f9-741178a1e20d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:05.830886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d174fe-cc8c-453c-b3f9-741178a1e20d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:05.831027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d174fe-cc8c-453c-b3f9-741178a1e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:05.853528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-61d174fe-cc8c-453c-b3f9-741178a1e20d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:16:05.854688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-61d174fe-cc8c-453c-b3f9-741178a1e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:05.861522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:16:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:16:05.896929 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51970-ef3f-4c0d-9e33-3fd87806de5c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:16:05.907594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b51970-ef3f-4c0d-9e33-3fd87806de5c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:16:05.910814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:16:05.911382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:05.911670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:05.911953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:05.920459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:16:05.946173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb0650-206d-435b-8ed5-139508c45aca service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:16:05.955282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 747/1494] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:16:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:16:09.597695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:09.598251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:09.598391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:09.600081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:16:09.605178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097c49-aa83-487e-99b1-b190af8a45ff None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:09.605568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097c49-aa83-487e-99b1-b190af8a45ff None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:09.605772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097c49-aa83-487e-99b1-b190af8a45ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:09.628648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4a097c49-aa83-487e-99b1-b190af8a45ff None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:16:09.629761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4a097c49-aa83-487e-99b1-b190af8a45ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:09.637734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:16:09.695104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:16:09.698064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:09.765187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2c8c2-da81-4ee6-b1f2-b633b472eaa3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:16:09.768457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:16:09.769037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:09.769325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:09.769604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:09.778521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:16:09.803041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31388-69cf-4d6d-bd73-87b7345d3374 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:16:09.812444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 749/1497] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:16:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:16:11.821691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0a1d-9f8b-43cf-9f6f-e3f0185d9029 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:11.822264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0a1d-9f8b-43cf-9f6f-e3f0185d9029 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:11.822264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0a1d-9f8b-43cf-9f6f-e3f0185d9029 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:11.823950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 10:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:16:11.829074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee6ad-2b58-4fc3-9c1d-145d93de06f1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:11.829486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee6ad-2b58-4fc3-9c1d-145d93de06f1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:11.829635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee6ad-2b58-4fc3-9c1d-145d93de06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:11.853379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-adcee6ad-2b58-4fc3-9c1d-145d93de06f1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:16:11.854530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-adcee6ad-2b58-4fc3-9c1d-145d93de06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:11.861310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:16:11.918306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2ec01-7d5f-41a7-9d3f-f2f969628cf6 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:11.918601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2ec01-7d5f-41a7-9d3f-f2f969628cf6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:11.918891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2ec01-7d5f-41a7-9d3f-f2f969628cf6 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:11.920617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 750/1500] 10.222.0.11 () {54 vars in 961 bytes} [Wed Apr 6 10:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:16:11.925188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b253033-a5c0-4b7d-bd3a-714c5d8bec67 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:11.925481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b253033-a5c0-4b7d-bd3a-714c5d8bec67 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:11.925763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b253033-a5c0-4b7d-bd3a-714c5d8bec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:11.947924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0b253033-a5c0-4b7d-bd3a-714c5d8bec67 None None] MFA Rules not processed for user `125ce3f900a94e639c62b77d4f7d9c81`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:16:11.949072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0b253033-a5c0-4b7d-bd3a-714c5d8bec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:16:11.954822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 751/1501] 10.222.0.11 () {58 vars in 1058 bytes} [Wed Apr 6 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:16:11.963073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2ec01-7d5f-41a7-9d3f-f2f969628cf6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:16:11.973238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2ec01-7d5f-41a7-9d3f-f2f969628cf6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:16:11.977032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:16:11.977618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:16:11.978006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:16:11.978291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:16:11.987088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:16:12.011997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb9ec-7cab-467e-942f-66d341fcde66 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:16:12.021135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 751/1502] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:16:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:47.966965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656ea0-f27e-412d-af12-1a41284a4a82 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:47.967525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656ea0-f27e-412d-af12-1a41284a4a82 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:47.967525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656ea0-f27e-412d-af12-1a41284a4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:47.999835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c9656ea0-f27e-412d-af12-1a41284a4a82 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.001417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c9656ea0-f27e-412d-af12-1a41284a4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.013519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 752/1503] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.024551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.025089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.025089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.032336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede7b9-ceb8-406b-b575-7a86053b9967 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.032995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede7b9-ceb8-406b-b575-7a86053b9967 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.033495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede7b9-ceb8-406b-b575-7a86053b9967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.065520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.069953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.073914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a0ede7b9-ceb8-406b-b575-7a86053b9967 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.075406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a0ede7b9-ceb8-406b-b575-7a86053b9967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.077566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 752/1504] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.086322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.091523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 753/1505] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:17:48.099061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791a74-1bd2-4060-baad-de30a1f6b80a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.102893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.103444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.103958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.104716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.105612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.106047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.106333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.107289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:48.107604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.141681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.143743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.155751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.160262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 754/1506] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:17:48.165901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.176962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 753/1507] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:48.181518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32238b-ba71-4de8-bc72-14e46bac3f62 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.190340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.191390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.191900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.192400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.193352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:48.194465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.220091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.228613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.245399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73d71-ade6-4308-b411-2f281a639f13 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.248696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 755/1508] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:17:48.258040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.268272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.269298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.269822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.270607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.271522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.281919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a4cc-c864-4739-896c-b7240a3d67c5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.305632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.306649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.307167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.307677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.308927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.330287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53da644-a565-4025-8a1a-f02ce1c48294 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.335568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdd26a-9c70-4762-8fe1-52792069f39c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.464867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 754/1509] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:17:48.466314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623cc-5350-4fe0-81a3-12e47c69dd21 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.466621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623cc-5350-4fe0-81a3-12e47c69dd21 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.466995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1623cc-5350-4fe0-81a3-12e47c69dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.495667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-db1623cc-5350-4fe0-81a3-12e47c69dd21 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.495667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-db1623cc-5350-4fe0-81a3-12e47c69dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.495942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 756/1510] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:17:48.495942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.495942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.496168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.517768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.518936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.561167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 755/1511] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.562430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010ae9-94b5-4d9b-9be7-9850ff754cc7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.562726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010ae9-94b5-4d9b-9be7-9850ff754cc7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.563009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010ae9-94b5-4d9b-9be7-9850ff754cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.583336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 757/1512] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.584151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.584924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-69010ae9-94b5-4d9b-9be7-9850ff754cc7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.586120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-69010ae9-94b5-4d9b-9be7-9850ff754cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.593221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 756/1513] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.593975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d50825-8142-4dc7-a4f7-7fbd558d48fb None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.594454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e64cb-0bfd-4f58-8002-64e06dc50f05 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.594747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e64cb-0bfd-4f58-8002-64e06dc50f05 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.595031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e64cb-0bfd-4f58-8002-64e06dc50f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.604805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.605491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.605782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.606201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.606917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.617025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-915e64cb-0bfd-4f58-8002-64e06dc50f05 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.618178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-915e64cb-0bfd-4f58-8002-64e06dc50f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.625198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 757/1514] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.626413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78c9e-e43a-4a39-92d8-ac349bd339c7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.626700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78c9e-e43a-4a39-92d8-ac349bd339c7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.627080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78c9e-e43a-4a39-92d8-ac349bd339c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.632927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46b51c-fb0d-4a00-8136-1661260f36be admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.650535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1fa78c9e-e43a-4a39-92d8-ac349bd339c7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.659939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1fa78c9e-e43a-4a39-92d8-ac349bd339c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.659939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 758/1515] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.659939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.660250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.660250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.682698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.683812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.690867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 759/1516] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.691293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.701161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8aacd-5b5c-4a8c-ac7a-09a68df99129 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.705383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.706021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.706314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.706604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.707231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.729211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 758/1517] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:48.729211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249c8a-7778-48a4-8d5b-146e05af3503 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.729211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249c8a-7778-48a4-8d5b-146e05af3503 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.729211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249c8a-7778-48a4-8d5b-146e05af3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.732728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a738-0470-41f1-a8cf-af9dcb2f0066 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.752083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ea249c8a-7778-48a4-8d5b-146e05af3503 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.753187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ea249c8a-7778-48a4-8d5b-146e05af3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.760780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 759/1518] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.769524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bc5-0dea-4261-8573-abdf217000b5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.769524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bc5-0dea-4261-8573-abdf217000b5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.769524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4bc5-0dea-4261-8573-abdf217000b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.784140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3f9c4bc5-0dea-4261-8573-abdf217000b5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.785237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3f9c4bc5-0dea-4261-8573-abdf217000b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.793077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 760/1519] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.794380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1b4-5527-4b53-bf05-b4385bdc5215 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.794662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1b4-5527-4b53-bf05-b4385bdc5215 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.794949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d1b4-5527-4b53-bf05-b4385bdc5215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.816204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d141d1b4-5527-4b53-bf05-b4385bdc5215 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.817057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 760/1520] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:48.817309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d141d1b4-5527-4b53-bf05-b4385bdc5215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.818334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732060-d6e6-4c31-95ff-77f3fa47a862 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.818753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732060-d6e6-4c31-95ff-77f3fa47a862 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.819155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732060-d6e6-4c31-95ff-77f3fa47a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.825644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 761/1521] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.832610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.832610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.832610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.843378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a7732060-d6e6-4c31-95ff-77f3fa47a862 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.844659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a7732060-d6e6-4c31-95ff-77f3fa47a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.848750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.850370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.852438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 761/1522] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.853610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.853903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.854219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.859460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 762/1523] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.860454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.870809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ca585-ff90-4e0e-99be-0acfa0849633 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.875104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.875686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.875971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.876244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.876763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:48.877060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.877915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:48.884909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 762/1524] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:48.885659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.894322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d8ada-bc24-45a7-be1f-b5ae34af1d1f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.899057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.899622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.899911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.900192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.900874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:48.901174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.903386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.914731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 763/1525] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:48.915503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.924202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73ce9-7f41-4fcd-8e33-c5029513dcda admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.926970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.929272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.929849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.930185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.930467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.931152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:48.931454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.940743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 763/1526] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:48.941541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.950783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36817f18-f837-41d2-8add-41bf0bb3c592 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.955127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.955786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.956080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.956366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.957060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.960532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.981202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 764/1527] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:48.981202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:48.983119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:48.987134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332ab1-3d93-4543-8aee-e4e33e13b919 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:48.992541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:48.993183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:48.993533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:48.993878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:48.997237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 764/1528] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:48.997389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:48.997389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:48.997573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.006222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770deb5-bc8f-4717-9395-b1f78adc7139 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.010368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.010948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.011236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.011520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.012204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:49.012506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.021239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.034675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 765/1529] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:49.037174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.038821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.047383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eae133-50b8-45f0-afdc-7c0d094d90bb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.051504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.052079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.052238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 765/1530] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:49.052667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.052961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.053738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.054441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:49.054745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.065316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d444-97a8-4288-ba37-b02f7d2c641f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.069826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.070429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.070723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.071005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.071688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:17:49.071990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.079457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.092493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 766/1531] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:49.093242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.097217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.105178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52cca7-c785-49a8-985b-f42c0477beb9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.109386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.110221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.110507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.110786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] PATH_INFO: `/v3/projects/474c373d715f467baa3762fdef8c160a/users/00df2776f7024acc888a4c9b2e1cc891/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.111372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 766/1532] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:17:49.112155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.121728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcc1e6-acf1-4bbb-806d-a40dcca53a29 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.125851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.126466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.126760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.127046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.127680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.133057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474c373d715f467baa3762fdef8c160a, user_id=00df2776f7024acc888a4c9b2e1cc891, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.154039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.164601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.239502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 767/1533] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:49 2022] PUT /identity/v3/projects/474c373d715f467baa3762fdef8c160a/users/00df2776f7024acc888a4c9b2e1cc891/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:49.240286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.257241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 767/1534] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:49.258219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.311708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9272d-06cf-42e1-95a9-e01d88d01a61 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.327356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5b5f2-e915-4386-8e13-00b36bb6468d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.331962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.332784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.333073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.333357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] PATH_INFO: `/v3/projects/3139a718521744158d655456f3529f58/users/52db54eb676744c0afd7533c122ef847/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.352761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3139a718521744158d655456f3529f58, user_id=52db54eb676744c0afd7533c122ef847, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.372575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.373168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.373455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.373737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.374400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.378811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.400229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.446022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 768/1535] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:49 2022] PUT /identity/v3/projects/3139a718521744158d655456f3529f58/users/52db54eb676744c0afd7533c122ef847/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:49.447141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.465004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 768/1536] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:49.470348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.518706 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4ba4-2af9-42cb-bea7-6d422ab125d9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.557978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fcc2-356e-40e9-9d4a-4f71399be854 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.562157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.562752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.563049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.563326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.563956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.581176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.581775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.582104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.582392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.583030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.589995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.610161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.708251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 769/1537] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 391 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:49.709100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.739977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 769/1538] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:49.739977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:49.777496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44a554-b4a4-4a70-85e6-989654aba081 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.814916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb3429-ccff-48c5-aa63-01382272d940 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:49.821641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.822262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.822553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.822837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.823491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.844017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:49.844819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.845226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.845611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.846387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:49.849234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1ce8-aeed-4183-be0a-89040f0770f0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.873178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:49.966200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 770/1539] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 405 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:49.967444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81a82-6987-49a9-8c6c-8b65a6f8ebd2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:49.967733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81a82-6987-49a9-8c6c-8b65a6f8ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:49.968013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81a82-6987-49a9-8c6c-8b65a6f8ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:49.989866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 770/1540] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.000133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.000272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-22e81a82-6987-49a9-8c6c-8b65a6f8ebd2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:50.000272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-22e81a82-6987-49a9-8c6c-8b65a6f8ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:50.061026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 771/1541] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:50.062291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.062421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f874-8865-488d-983c-c97f448d670b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.062593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.062862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.067617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.068291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.068675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.069586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.070327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.096081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.099483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] MFA Rules not processed for user `52db54eb676744c0afd7533c122ef847`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:50.100970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:50.154364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 771/1542] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:49 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.158302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.168277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d360f9-e659-45d9-9ec9-3adda22d47a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.172209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.172807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.173094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.173376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.174051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.174325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 772/1543] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:50.175199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.188139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc7a0-0cca-472f-98bb-50d70ba5c3c4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.192711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.193329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.194245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.195162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.195805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.203315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.221402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.292054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 772/1544] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.293045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.302204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7403-45b5-4afb-be05-7a16be1c1dc3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.307142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.307755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.308040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.312563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.312563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.312774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 773/1545] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.312774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.319935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7943f44-fa47-462f-921e-fb2461fdc421 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.324321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.324888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.325178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.325460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.326120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.334467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.352003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.429135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 773/1546] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.430101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.438964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b64031-dfe9-410d-87d8-78def14cc597 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.443027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.443598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.443884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.444340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.444767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.469730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.508778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 774/1547] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.509607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.511225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:50.573713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161025-0802-41a4-9e43-0998dbd63080 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.576947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.577516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.577801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.578111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.586562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.607402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 774/1548] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:50.608291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.612128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fab36-0d19-4e40-9544-2c9db0e47fa6 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.618502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b72c00-af13-4b99-92d3-37dfad304e9f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.622291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 775/1549] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:50.622943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.623546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.623665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f994d-3c5f-4560-8387-58a05900c197 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.623832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.623931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f994d-3c5f-4560-8387-58a05900c197 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.624111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.624221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f994d-3c5f-4560-8387-58a05900c197 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.624932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.625793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 776/1550] 10.222.0.11 () {54 vars in 954 bytes} [Wed Apr 6 10:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:17:50.626374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f994d-3c5f-4560-8387-58a05900c197 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.638391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f994d-3c5f-4560-8387-58a05900c197 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.642535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.643114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.643399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.643798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.644495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.652665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.664084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 775/1551] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.664888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.671244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.673924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fe2e-4d6f-4a62-88d2-a6e064d1cd0f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.678361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.678879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.679086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.679369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.680050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.682409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 777/1552] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.683228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.692442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324428-b7a6-42cb-a8ee-3f7854f321eb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.697235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.697809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.698171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.698457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.699136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.705142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.716247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 776/1553] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.717024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.724915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.728961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b8ffb-57c6-4900-a7a5-8841e9d6cd6f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.733322 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.733958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.734227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.734509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.735197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.736624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 778/1554] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.737439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.749173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364a72-d714-42f0-ba2c-c490dc597bce admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.753314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.755562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.755562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.755562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.755562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.760910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbee32-df10-4b6b-b942-b2063d6f0318 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.776430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 777/1555] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.776430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.776430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.776430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.781826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.796566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 779/1556] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:50.796566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.802952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:50.804337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a585-faa6-4052-9db6-dbe266b3cb4a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.811364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:50.811511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.811511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.811511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.811511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] PATH_INFO: `/v3/projects/cefb8d0f26114b949d69f02086f29fe3/users/999ab6db9856482b8383316961b8ce2b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.834101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefb8d0f26114b949d69f02086f29fe3, user_id=999ab6db9856482b8383316961b8ce2b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.860619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:50.892541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 778/1557] 10.222.0.11 () {58 vars in 1051 bytes} [Wed Apr 6 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:50.893509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.903819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0822b9a-4471-40ac-ae9a-2ad6bb61f7a4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:50.907948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:50.910489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:50.910489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:50.910489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] PATH_INFO: `/v3/projects/872b80d8f161486ab774165084e4feca/users/279b268212d54d95b10267e7658722df/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:50.928945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=872b80d8f161486ab774165084e4feca, user_id=279b268212d54d95b10267e7658722df, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:50.930512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 780/1558] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:50 2022] PUT /identity/v3/projects/cefb8d0f26114b949d69f02086f29fe3/users/999ab6db9856482b8383316961b8ce2b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:50.939356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:50.956098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.010671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98665-4451-4b61-b88e-b545e0a106eb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.014944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.015774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.016061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.016339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] PATH_INFO: `/v3/projects/6c26929cdc2e419397fb84381a87eae9/users/16774d5cebcc40d8aea59afa90926050/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.042827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c26929cdc2e419397fb84381a87eae9, user_id=16774d5cebcc40d8aea59afa90926050, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:51.065884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.069489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 779/1559] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:50 2022] PUT /identity/v3/projects/872b80d8f161486ab774165084e4feca/users/279b268212d54d95b10267e7658722df/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:51.070851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.140049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641025cb-55a5-44db-b36c-3f933e8ecbef admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.144346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.145416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.145744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.146114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] PATH_INFO: `/v3/projects/978ca7e487864705bd9b04e0859b58dc/users/7cc1b120a98a469ebb2c617a7a44ff8d/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.166591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 781/1560] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:50 2022] PUT /identity/v3/projects/6c26929cdc2e419397fb84381a87eae9/users/16774d5cebcc40d8aea59afa90926050/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:51.166591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.168315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978ca7e487864705bd9b04e0859b58dc, user_id=7cc1b120a98a469ebb2c617a7a44ff8d, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:51.200206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.240293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55861b2-2684-4a79-a7e6-a1d3ca76d852 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.245759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.246656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.246950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.247231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] PATH_INFO: `/v3/projects/c066d9dbd3d040d79acbcf1a05922c8d/users/bbf4a3974a5d4b25a6ec5bde53284cdd/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.269000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c066d9dbd3d040d79acbcf1a05922c8d, user_id=bbf4a3974a5d4b25a6ec5bde53284cdd, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:51.283017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 780/1561] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:51 2022] PUT /identity/v3/projects/978ca7e487864705bd9b04e0859b58dc/users/7cc1b120a98a469ebb2c617a7a44ff8d/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:51.291955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.296790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.361874 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af576d6d-dcd7-40aa-98da-4a698e2ddfe4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.369796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.370409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.370756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.371150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] PATH_INFO: `/v3/projects/1ffd94a428684058ae80ac859a4f690e/users/edf469d18334489ca7de5775bead3b81/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.393392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffd94a428684058ae80ac859a4f690e, user_id=edf469d18334489ca7de5775bead3b81, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:51.398659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 782/1562] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:51 2022] PUT /identity/v3/projects/c066d9dbd3d040d79acbcf1a05922c8d/users/bbf4a3974a5d4b25a6ec5bde53284cdd/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:51.407542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.421507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee4d7-4436-4230-8670-f684e5975e59 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.486670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3061f-d01d-4d8f-ac5b-dbecfaabf53a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.494297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.494892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.495184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.495469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.549420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 781/1563] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:51 2022] PUT /identity/v3/projects/1ffd94a428684058ae80ac859a4f690e/users/edf469d18334489ca7de5775bead3b81/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:51.550503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348213c-04fd-481a-b209-2846e115b787 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.550788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348213c-04fd-481a-b209-2846e115b787 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.551071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348213c-04fd-481a-b209-2846e115b787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.558848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:51.585548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f2123-cebf-4343-af8c-093880549455 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:51.589305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3348213c-04fd-481a-b209-2846e115b787 None None] MFA Rules not processed for user `999ab6db9856482b8383316961b8ce2b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.590477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3348213c-04fd-481a-b209-2846e115b787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.595655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 783/1564] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:51.596636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ddf7-9c25-4e4c-8465-dca371e09d65 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.596938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ddf7-9c25-4e4c-8465-dca371e09d65 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.597226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ddf7-9c25-4e4c-8465-dca371e09d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.620547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-be32ddf7-9c25-4e4c-8465-dca371e09d65 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.621715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-be32ddf7-9c25-4e4c-8465-dca371e09d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.672713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 782/1565] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.673940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bdb3-c372-4fb4-a86c-21e2b65f3c9b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.674276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bdb3-c372-4fb4-a86c-21e2b65f3c9b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.674557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564bdb3-c372-4fb4-a86c-21e2b65f3c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.692661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 784/1566] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.692661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc35d11-b349-45ab-ace8-205ab44a5c6e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.692661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc35d11-b349-45ab-ace8-205ab44a5c6e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.692661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc35d11-b349-45ab-ace8-205ab44a5c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.716375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c564bdb3-c372-4fb4-a86c-21e2b65f3c9b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.717815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c564bdb3-c372-4fb4-a86c-21e2b65f3c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.727064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 783/1567] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.730367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e06b-ccc7-451d-91d0-c852d903703c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.730367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e06b-ccc7-451d-91d0-c852d903703c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.730367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e06b-ccc7-451d-91d0-c852d903703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.738081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2dc35d11-b349-45ab-ace8-205ab44a5c6e None None] MFA Rules not processed for user `7cc1b120a98a469ebb2c617a7a44ff8d`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.739838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2dc35d11-b349-45ab-ace8-205ab44a5c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.777024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-78c5e06b-ccc7-451d-91d0-c852d903703c None None] MFA Rules not processed for user `bbf4a3974a5d4b25a6ec5bde53284cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.778387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-78c5e06b-ccc7-451d-91d0-c852d903703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.833632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 785/1568] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.833632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.833632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.833632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.859509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:51.860800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:51.867132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 784/1569] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.868622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe44b8-8859-4522-a09f-217448e49f07 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.868984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe44b8-8859-4522-a09f-217448e49f07 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.869335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe44b8-8859-4522-a09f-217448e49f07 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.869773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 786/1570] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:51.870813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.874840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 785/1571] 10.222.0.11 () {54 vars in 954 bytes} [Wed Apr 6 10:17:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:17:51.875770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe44b8-8859-4522-a09f-217448e49f07 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:51.955616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe44b8-8859-4522-a09f-217448e49f07 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:51.961200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:51.961907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:51.962465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:51.962823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:51.974445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.008986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.023131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 786/1572] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:52.024142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.035242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616316f-8456-42a2-be5b-95b0a62f9f78 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.046868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.047572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.048032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.048372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.049082 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.067401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5bad-ff5a-4d19-a021-4da694c986bc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.075690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.076291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.076584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.076867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.078198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8858032-1bd1-4949-b359-cf4279f1f8e3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.087177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.112648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.122843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 787/1573] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:52.123603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.132596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2acaf-8899-49b3-8a74-8f5bb188aaa7 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.137018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.140614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.140973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.141203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.141860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.175566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.287047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 787/1574] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:52 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:52.288723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.291809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.291809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.314627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:52.315873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:52.394480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 788/1575] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:17:52 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:52.395829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.420039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 788/1576] 10.222.0.11 () {58 vars in 1051 bytes} [Wed Apr 6 10:17:52 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:52.420039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.529558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cb77-538f-4f7f-99ce-f9e1a874dc02 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.535260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb06b1-abf8-4ca9-b7b7-ac7c001fda21 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.536702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.538113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.539480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.539480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.607096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.607805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.608253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.608573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.650463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.708940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.738501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.742919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.771005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 789/1577] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:52 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:52.774498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 789/1578] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:52.774971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.776350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.795755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc65f5-336d-4115-8e54-02692bc30550 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.796538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6179-3df3-4f87-a808-88fbd0c85e19 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.803184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.803974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.804411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.804584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.805516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.806805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:52.809228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:52.811044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:52.811044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:52.816465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:52.845313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.866858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:52.961718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 790/1579] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:52 2022] POST /identity/v3/users => generated 309 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:52.967681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:52.989878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9b9c8-9e26-4eae-9574-de48bd654c81 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:52.999901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 790/1580] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:17:52 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:17:53.000949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.009910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.010552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.010850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.011140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.034692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff7c6-2da9-4012-b0ee-337d42a42e26 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.051178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.053038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.053640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.054217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.055107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.092542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.118106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 791/1581] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:53.118106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.134688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd322-41bf-47d6-b851-f07df23d1292 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.140651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.141371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.142455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.142746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.143922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.172449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.186239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.202971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 792/1582] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:53.203581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.223382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242e18a-44ef-42a6-bca9-160b60fb07d9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.232611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.232846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.233494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.234196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.234484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] PATH_INFO: `/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.249551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 791/1583] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:52 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:53.250339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.263954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4052fe-e939-4572-991d-fe93a96091c4 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.270223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.271139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.271433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.271768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] PATH_INFO: `/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.276589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f545ec21a5fc44bdbb2cbb3e9e93ca41, user_id=14df1daa21cc42219b3aa994dbb70bb4, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.293758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c746bb242746dd9138d37a5025792b, user_id=652b4336b45f43bfb7b4348a87d9686b, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.322736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.330219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.430497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 792/1584] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:53 2022] PUT /identity/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:53.434626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.457629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 793/1585] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:53 2022] PUT /identity/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:53.462106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.619848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9a32-fcd1-4afd-a6e1-104a9e195d50 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.633587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.634336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.634452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d4264-7cc8-4d38-96f5-ff1e56ce43dd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.634800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.635180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.636046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.648466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.655039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.655039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.655039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.655039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.699644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.713591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.719080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 794/1586] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:17:53.726897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.739319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 793/1587] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:17:53.743176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.763267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c137-69c2-4c81-bad0-1c1ffcf7ddef admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.767068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.768455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.769047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.769440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] PATH_INFO: `/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.772891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f545ec21a5fc44bdbb2cbb3e9e93ca41, user_id=14df1daa21cc42219b3aa994dbb70bb4, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:53.809128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:53.832909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 794/1588] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:53 2022] PUT /identity/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:53.833413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:53.876145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36a7a5-77c7-483a-ae20-240dc4eb046c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.969947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7127-0c31-4c6f-baaf-2ec6040544f3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:53.983363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:53.985456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:53.986087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:53.987216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] PATH_INFO: `/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:53.991960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c746bb242746dd9138d37a5025792b, user_id=652b4336b45f43bfb7b4348a87d9686b, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.065332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:54.065944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.066983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.066983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.074242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.109030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 795/1589] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:53 2022] PUT /identity/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:54.112666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:54.267707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.277581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40314c-9bc5-4d6a-843e-2147a730beff admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:54.291941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:54.296841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.296841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.296841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.296841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.299333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.327444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 795/1590] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:54.329568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.330171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:54.344580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 796/1591] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:54.348039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:54.364132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283abfb-4344-4058-9427-4907a681d97f service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:54.374463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a2dd-4a86-4c2d-96d9-313807146d0b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:54.374848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:54.376372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.377874 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.378335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.378994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:54.379837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.380098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.380430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] PATH_INFO: `/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.381889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.383281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f545ec21a5fc44bdbb2cbb3e9e93ca41, user_id=14df1daa21cc42219b3aa994dbb70bb4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.416215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be8e57-d534-4a83-a67e-9efe6db74a38 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.434809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.468038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 796/1592] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:17:54.469689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:54.496884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6339194-016c-44b3-aecd-d06cd8f27e75 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:54.507615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:54.519055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 797/1593] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:54 2022] PUT /identity/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41/users/14df1daa21cc42219b3aa994dbb70bb4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:54.532402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.532699 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.532982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.534764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.535175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.535464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] PATH_INFO: `/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.539206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c746bb242746dd9138d37a5025792b, user_id=652b4336b45f43bfb7b4348a87d9686b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:54.603358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd13c07-445c-4b70-8685-ea9f78958dcb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:54.609687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] MFA Rules not processed for user `14df1daa21cc42219b3aa994dbb70bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:54.610967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:54.720866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 798/1594] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:54 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:54.732210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:54.748164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 797/1595] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:17:54 2022] PUT /identity/v3/projects/55c746bb242746dd9138d37a5025792b/users/652b4336b45f43bfb7b4348a87d9686b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:54.759505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:54.760028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:54.760595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:54.840652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] MFA Rules not processed for user `652b4336b45f43bfb7b4348a87d9686b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:54.846129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:54.857637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667eac-0444-44af-b86e-9f9237bee0df None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:54.994480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 798/1596] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:54 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:17:55.040859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:55.041469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:55.041762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:55.042076 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:55.163037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:55.188701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:55.199777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 799/1597] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:55.269239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:55.276542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de501fe-96b7-4047-baaa-4359ab0a096a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:55.280077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:55.280659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:55.280943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:55.281222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:55.299522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:55.338758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:55.349049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 799/1598] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:55.379337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:55.586466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:55.599284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920e873-7ec7-4636-b4ca-6f4b1f783354 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:55.604030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f5b5-c084-4827-bf0b-86deebf38724 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:55.627251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:55.627251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:55.627251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:55.627658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:55.636091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] PATH_INFO: `/v3/users/bbf4a3974a5d4b25a6ec5bde53284cdd` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:55.637077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:55.637534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:55.639049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] PATH_INFO: `/v3/users/7cc1b120a98a469ebb2c617a7a44ff8d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:55.640523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf4a3974a5d4b25a6ec5bde53284cdd)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:55.647577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc1b120a98a469ebb2c617a7a44ff8d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:55.742031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: WARNING py.warnings [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 10:17:55.742031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: warnings.warn(msg) Apr 06 10:17:55.742031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: Apr 06 10:17:55.751286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:55.751493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:56.054328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc1b120a98a469ebb2c617a7a44ff8d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.068290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf4a3974a5d4b25a6ec5bde53284cdd'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.093080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf4a3974a5d4b25a6ec5bde53284cdd'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.154207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc1b120a98a469ebb2c617a7a44ff8d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.170570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc1b120a98a469ebb2c617a7a44ff8d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.196841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc1b120a98a469ebb2c617a7a44ff8d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.199067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0162744-6102-465d-a648-102ceb103c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc1b120a98a469ebb2c617a7a44ff8d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.207938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 800/1599] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:17:55 2022] DELETE /identity/v3/users/7cc1b120a98a469ebb2c617a7a44ff8d => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:56.232952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cce53-8078-4390-83b7-2b46383beddc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.232952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cce53-8078-4390-83b7-2b46383beddc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.232952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cce53-8078-4390-83b7-2b46383beddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.261446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-298cce53-8078-4390-83b7-2b46383beddc None None] MFA Rules not processed for user `edf469d18334489ca7de5775bead3b81`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:56.262702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-298cce53-8078-4390-83b7-2b46383beddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.282418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf4a3974a5d4b25a6ec5bde53284cdd'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.315010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf4a3974a5d4b25a6ec5bde53284cdd'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.319862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78d18754-7601-4884-a94b-ab67289d2966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf4a3974a5d4b25a6ec5bde53284cdd'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:56.338438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 800/1600] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:17:55 2022] DELETE /identity/v3/users/bbf4a3974a5d4b25a6ec5bde53284cdd => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:56.339825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.340119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.340418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.370984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:56.372350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.411856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 801/1601] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:56.413313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e1ad-bedf-4412-97ad-5f126cf7bbb4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.413744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e1ad-bedf-4412-97ad-5f126cf7bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.414218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e1ad-bedf-4412-97ad-5f126cf7bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.441234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-cf32e1ad-bedf-4412-97ad-5f126cf7bbb4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:56.442771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-cf32e1ad-bedf-4412-97ad-5f126cf7bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.569444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 802/1602] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:56.569657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 801/1603] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:56.569752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.569752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.570444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.598105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:56.598105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.607398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] MFA Rules not processed for user `edf469d18334489ca7de5775bead3b81`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:56.608861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.739356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 803/1604] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:17:56.740695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:56.742585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c327-5acc-4331-b92e-bcafad9ca40f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:56.752217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbca725-ecd6-4c66-8433-60927ee08ff8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:56.757204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:56.764951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.764951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.764951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.765252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:56.765252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.765252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.765252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.769487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:56.781699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:56.799898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:56.816440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 804/1605] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:56.822190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:56.822190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:56.860193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c123547-c7b8-4a8c-997b-f0b959caadb6 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:56.872400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 802/1606] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:56.955616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f891-5592-4959-875f-a8970d1c3184 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:56.968626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:56.969253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:56.969549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:56.969965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:56.987783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:57.040852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e08e1a-1db6-4eed-94a4-cadfd2ef4745 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:57.069109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 805/1607] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:56 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:58.280545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:58.281493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:58.282545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:58.284840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 803/1608] 10.222.0.11 () {54 vars in 912 bytes} [Wed Apr 6 10:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:17:58.290537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:58.291018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:58.291345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:58.419373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:17:58.420706 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:58.437208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 806/1609] 10.222.0.11 () {58 vars in 1009 bytes} [Wed Apr 6 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:17:58.563689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:58.565496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:58.579602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18088f7-ce07-4857-8ce6-d8fae840df00 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:58.583780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:58.584567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:58.585246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:58.585711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:58.593728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:58.620828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:58.631513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 804/1610] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:17:58 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:17:58.892158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:58.894435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:58.905557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:58.908116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:58.927100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4df69-1aaa-4886-ab90-7d9a3df0bf20 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:58.928268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26106a3b-9c8e-4c2e-980b-5dcbb24db820 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:58.933309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:58.938421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:58.939233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:58.939526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:58.939811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] PATH_INFO: `/v3/projects/978ca7e487864705bd9b04e0859b58dc` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:58.942174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978ca7e487864705bd9b04e0859b58dc)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:58.946798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:58.948579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:58.949093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] PATH_INFO: `/v3/projects/c066d9dbd3d040d79acbcf1a05922c8d` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:58.954023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c066d9dbd3d040d79acbcf1a05922c8d)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:58.996337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: WARNING py.warnings [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 10:17:58.996337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: warnings.warn(msg) Apr 06 10:17:58.996337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: Apr 06 10:17:58.997537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:59.028211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:59.180498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c066d9dbd3d040d79acbcf1a05922c8d', 'request_id': 'req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.182811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978ca7e487864705bd9b04e0859b58dc', 'request_id': 'req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.202636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c066d9dbd3d040d79acbcf1a05922c8d', 'request_id': 'req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.215144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c066d9dbd3d040d79acbcf1a05922c8d', 'request_id': 'req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.251523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978ca7e487864705bd9b04e0859b58dc', 'request_id': 'req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.276070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978ca7e487864705bd9b04e0859b58dc', 'request_id': 'req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.296557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] The token cache is being invalidate because project 978ca7e487864705bd9b04e0859b58dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:17:59.297209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.297792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.302429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 807/1611] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:17:58 2022] DELETE /identity/v3/projects/978ca7e487864705bd9b04e0859b58dc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:17:59.304000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:59.307450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:59.343598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] The token cache is being invalidate because project c066d9dbd3d040d79acbcf1a05922c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:17:59.344168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.344763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.347994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 805/1612] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:17:58 2022] DELETE /identity/v3/projects/c066d9dbd3d040d79acbcf1a05922c8d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:17:59.351832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:17:59.354831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:17:59.448134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5b2e2-2cbe-4366-8a04-cba1ee2d16d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:59.510256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a4c7-4112-4087-bf4e-0e10c70d2f62 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:17:59.522942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:59.523776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:59.524119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:59.524455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] PATH_INFO: `/v3/users/14df1daa21cc42219b3aa994dbb70bb4` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:59.525598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=14df1daa21cc42219b3aa994dbb70bb4)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:59.573476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:17:59.585881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:17:59.585881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:17:59.585881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] PATH_INFO: `/v3/users/652b4336b45f43bfb7b4348a87d9686b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:17:59.585881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=652b4336b45f43bfb7b4348a87d9686b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:17:59.586554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:59.663418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:17:59.803284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14df1daa21cc42219b3aa994dbb70bb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.850502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14df1daa21cc42219b3aa994dbb70bb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.896460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652b4336b45f43bfb7b4348a87d9686b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.920480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14df1daa21cc42219b3aa994dbb70bb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.948364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14df1daa21cc42219b3aa994dbb70bb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.949156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d850c4dd-f2b5-43af-ab76-d479c4b73fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14df1daa21cc42219b3aa994dbb70bb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:17:59.963786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 806/1613] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:17:59 2022] DELETE /identity/v3/users/14df1daa21cc42219b3aa994dbb70bb4 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:17:59.996312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652b4336b45f43bfb7b4348a87d9686b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:00.005452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652b4336b45f43bfb7b4348a87d9686b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:00.049702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652b4336b45f43bfb7b4348a87d9686b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:00.051158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4eb428ac-67d5-4d97-a8b8-ce1c3651f6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652b4336b45f43bfb7b4348a87d9686b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:00.080672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 808/1614] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:17:59 2022] DELETE /identity/v3/users/652b4336b45f43bfb7b4348a87d9686b => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:00.188442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63f12-7191-4e50-b5f8-bda001ddd0e5 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:00.188811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63f12-7191-4e50-b5f8-bda001ddd0e5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:00.189442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da63f12-7191-4e50-b5f8-bda001ddd0e5 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:00.191822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 807/1615] 10.222.0.11 () {54 vars in 960 bytes} [Wed Apr 6 10:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:00.205394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:00.205783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:00.206167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:00.250078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] MFA Rules not processed for user `99c2c40c6d154576af32478a958db15e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:00.251281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:00.373492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 809/1616] 10.222.0.11 () {58 vars in 1057 bytes} [Wed Apr 6 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:00.384995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da63f12-7191-4e50-b5f8-bda001ddd0e5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:00.405487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da63f12-7191-4e50-b5f8-bda001ddd0e5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:00.410594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:00.411705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:00.413817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:00.414393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:00.416371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:00.433963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:00.509893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:00.533898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 808/1617] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:00.595510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:00.599617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:00.869590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3699c-c48d-497d-8dce-ac8b299b0c85 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:00.877892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:00.879217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:00.885324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:00.887834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] PATH_INFO: `/v3/users/999ab6db9856482b8383316961b8ce2b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:00.889381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] RBAC: Authorizing `identity:delete_user(user_id=999ab6db9856482b8383316961b8ce2b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:00.922307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:01.035578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:01.037389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:01.074212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1bb9-cf7b-4af8-97c1-221326f708bf service placement] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:01.095834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:01.097813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:01.098485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:01.098782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:01.107579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:01.142125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:01.203435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b60fd-af15-43d8-9d2f-bc6597311f83 service placement] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:01.222982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 809/1618] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:01.289359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999ab6db9856482b8383316961b8ce2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:01.370977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999ab6db9856482b8383316961b8ce2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:01.383593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999ab6db9856482b8383316961b8ce2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:01.412772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999ab6db9856482b8383316961b8ce2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:01.413571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999ab6db9856482b8383316961b8ce2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:01.467584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 810/1619] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:00 2022] DELETE /identity/v3/users/999ab6db9856482b8383316961b8ce2b => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:01.472607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:01.473868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:01.474194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:01.612950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:01.615858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:01.704663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:01.705836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:01.846102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 810/1620] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:01.855475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78964136-1dd6-411e-b990-4db7b7c1286c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:01.875690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:01.876683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:01.876980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:01.877311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] PATH_INFO: `/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:01.879817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f545ec21a5fc44bdbb2cbb3e9e93ca41)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:01.895180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:01.902598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:01.988172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:02.075098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabeba6-39ef-4f64-bfb3-0d718a5906e9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:02.083081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:02.084304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:02.085056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:02.085778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:02.126583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:02.178703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1849bc-a0fa-4446-9b02-e7ca9af5e794 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:02.194373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f545ec21a5fc44bdbb2cbb3e9e93ca41', 'request_id': 'req-f1bad38f-9537-414b-8443-57409f19f36c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:02.206203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 811/1621] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:02.279583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f545ec21a5fc44bdbb2cbb3e9e93ca41', 'request_id': 'req-f1bad38f-9537-414b-8443-57409f19f36c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:02.305498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f545ec21a5fc44bdbb2cbb3e9e93ca41', 'request_id': 'req-f1bad38f-9537-414b-8443-57409f19f36c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:02.321351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] The token cache is being invalidate because project f545ec21a5fc44bdbb2cbb3e9e93ca41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:02.321962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:02.328021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1bad38f-9537-414b-8443-57409f19f36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:02.332357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 811/1622] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:01 2022] DELETE /identity/v3/projects/f545ec21a5fc44bdbb2cbb3e9e93ca41 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:02.338756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:02.339298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:02.339764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:02.409375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:02.416585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:02.633575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 812/1623] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:02.642373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:02.643328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:02.643842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:02.690824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:02.693113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:02.712728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 812/1624] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:02.716648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:02.732092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c0aed-1a63-4b36-b168-710514018ad8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:02.754448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:02.755259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:02.755909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:02.756453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:02.757202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:02.758297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:02.825958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:02.851962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 813/1625] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:02.856096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:02.877359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc624c9-7ff5-45cc-9a69-7b1a924cfc51 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:02.903376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:02.903376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:02.903376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:02.903376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:02.903746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:02.938596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:03.050067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:03.051823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:03.056459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 813/1626] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:02 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:03.060540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:03.082394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136e9e-31cf-4408-aad7-c83c455ec527 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:03.217969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:03.218909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.219299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.219699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] PATH_INFO: `/v3/projects/55c746bb242746dd9138d37a5025792b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.220867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c746bb242746dd9138d37a5025792b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:03.250594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:03.302340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc703df4-15f7-4d73-b706-1cd893126c91 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:03.315875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:03.319053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.319943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.320126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.322069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:03.415873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c746bb242746dd9138d37a5025792b', 'request_id': 'req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:03.418159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:03.443840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c746bb242746dd9138d37a5025792b', 'request_id': 'req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:03.453530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c746bb242746dd9138d37a5025792b', 'request_id': 'req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:03.547768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 814/1627] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:03 2022] POST /identity/v3/users => generated 290 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:03.548786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:03.574927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] The token cache is being invalidate because project 55c746bb242746dd9138d37a5025792b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:03.575183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206866-039a-472c-9e2b-e61e16b1cb1b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:03.575298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:03.580351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a1d83eb-c07f-4236-82fd-bac0e5aa6b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:03.580351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 814/1628] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:03 2022] DELETE /identity/v3/projects/55c746bb242746dd9138d37a5025792b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:03.586406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b179e-e307-42a2-ac2f-b97affefae4d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.586757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b179e-e307-42a2-ac2f-b97affefae4d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.587045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b179e-e307-42a2-ac2f-b97affefae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.653887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4e6b179e-e307-42a2-ac2f-b97affefae4d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:03.654636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4e6b179e-e307-42a2-ac2f-b97affefae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:03.711653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:03.713478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.714094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.714524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.715584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:03.749627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:03.775639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 815/1629] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:18:03.776777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:03.783245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:03.812180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05889b-9fda-4e7d-aa6c-1ab6ffcf5503 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:03.823290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:03.826558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.827075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.827522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] PATH_INFO: `/v3/projects/b3726372697e4e96aa61890e5fd0c74f/users/2baa9d8675bc48feab510bce45a01c66/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.874464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3726372697e4e96aa61890e5fd0c74f, user_id=2baa9d8675bc48feab510bce45a01c66, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:03.879036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 815/1630] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:03.894999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:03.902164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:03.910246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:03.952774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:03.953968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:03.965004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234438d-adc2-4e6f-a740-a83380246e3b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:03.979234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 816/1631] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:03.980769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.006787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40498526-41dd-45e6-842f-968693d5ad4b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:04.033014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:04.033646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:04.033950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:04.034585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:04.035302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:04.035602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:04.095784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:04.120886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 816/1632] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:03 2022] PUT /identity/v3/projects/b3726372697e4e96aa61890e5fd0c74f/users/2baa9d8675bc48feab510bce45a01c66/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:04.132256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:04.132694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:04.133097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:04.149283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 817/1633] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:04.155173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.172928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b475c-ddc3-47ec-bf87-623bebba810c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:04.221573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] MFA Rules not processed for user `2baa9d8675bc48feab510bce45a01c66`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:04.222795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:04.285209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:04.285880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:04.286340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:04.286623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:04.290656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:04.335780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:04.394175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 817/1634] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:04 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:04.399267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.436695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 818/1635] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:04 2022] POST /identity/v3/projects => generated 389 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:04.438905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.447246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cde0-3193-47fb-960d-4c55a5bdcfdd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:04.560448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf79ff-771f-4912-9567-274af9bd49a0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:04.572624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:04.574209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:04.574682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:04.575122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:04.577140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:04.638727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:04.643670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:04.643670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:04.643670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:04.643670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:04.715795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:04.744805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:04.838126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 819/1636] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:04 2022] POST /identity/v3/users => generated 295 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:04.839340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.842780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:04.871618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 818/1637] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:04 2022] POST /identity/v3/projects => generated 375 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:04.872818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:04.891532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7589-f39d-4b9a-a1ae-86128e9858c9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:05.071401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a67a8-39e8-4cc4-a43c-17ca62812a52 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:05.078979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:05.079799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:05.080092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:05.080375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] PATH_INFO: `/v3/projects/cefb8d0f26114b949d69f02086f29fe3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:05.093890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefb8d0f26114b949d69f02086f29fe3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:05.099912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:05.100638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:05.100845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:05.101134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:05.101859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:05.141372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:05.167606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:05.183992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 819/1638] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:05.184937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:05.202222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2ab63-314d-4c9f-a4a6-081b13c86c87 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:05.212014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:05.213496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:05.213798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:05.214319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:05.215441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:05.284229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefb8d0f26114b949d69f02086f29fe3', 'request_id': 'req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.309650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefb8d0f26114b949d69f02086f29fe3', 'request_id': 'req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.317861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefb8d0f26114b949d69f02086f29fe3', 'request_id': 'req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.324348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:05.403983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] The token cache is being invalidate because project cefb8d0f26114b949d69f02086f29fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:05.404838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.414252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.416902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 820/1639] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:04 2022] DELETE /identity/v3/projects/cefb8d0f26114b949d69f02086f29fe3 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:05.418693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:05.421777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:05.466213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 820/1640] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:05 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:05.470407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:05.476002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:05.532446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78778a-7290-49ff-b17e-4de3274f36c0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:05.589683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a4f5-4a8f-4001-9dc2-e8f5f285a7cc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:05.604793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:05.606106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:05.606698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:05.607127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] PATH_INFO: `/v3/users/52db54eb676744c0afd7533c122ef847` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:05.611930 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52db54eb676744c0afd7533c122ef847)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:05.690148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:05.784029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:05.786221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:05.791002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:05.791646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] PATH_INFO: `/v3/projects/99fca67de7774edcbd6cde7d0a6afdb4/users/37cebf9ec09d48fe800ba01bfc613e6a/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:05.848022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fca67de7774edcbd6cde7d0a6afdb4, user_id=37cebf9ec09d48fe800ba01bfc613e6a, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:05.923510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e89955-650f-4e25-a95c-4f00955e547d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:05.942334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52db54eb676744c0afd7533c122ef847'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:05.968814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52db54eb676744c0afd7533c122ef847'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:06.036427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 821/1641] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:05 2022] PUT /identity/v3/projects/99fca67de7774edcbd6cde7d0a6afdb4/users/37cebf9ec09d48fe800ba01bfc613e6a/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:06.041597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b636-7b00-497d-850d-94156f6b07a2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.042059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b636-7b00-497d-850d-94156f6b07a2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.043522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b636-7b00-497d-850d-94156f6b07a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.350910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52db54eb676744c0afd7533c122ef847'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:06.352135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-06a8b636-7b00-497d-850d-94156f6b07a2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:06.352135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-06a8b636-7b00-497d-850d-94156f6b07a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.352948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52db54eb676744c0afd7533c122ef847'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:06.352948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52db54eb676744c0afd7533c122ef847'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:06.352948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 821/1642] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:05 2022] DELETE /identity/v3/users/52db54eb676744c0afd7533c122ef847 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:06.352948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:06.352948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.353438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 822/1643] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:06.353438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b4f-9a41-4859-89a5-47f5d0772f2e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.353438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b4f-9a41-4859-89a5-47f5d0772f2e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.353438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b4f-9a41-4859-89a5-47f5d0772f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.383244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7f866b4f-9a41-4859-89a5-47f5d0772f2e None None] MFA Rules not processed for user `37cebf9ec09d48fe800ba01bfc613e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:06.385307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7f866b4f-9a41-4859-89a5-47f5d0772f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.406161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7e401-47ad-4be5-8865-3d14332b12f0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:06.412086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:06.412838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.413037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.413397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.414405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:06.460259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4cde-b0c0-41d1-9d91-0b4bce917b38 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:06.496407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 822/1644] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:06.496407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177005-ce82-4c36-8064-8ef4116a01ca None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.496407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177005-ce82-4c36-8064-8ef4116a01ca None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.496407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177005-ce82-4c36-8064-8ef4116a01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.503409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 823/1645] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:06.505155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.505571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.506762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.540680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:06.542735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.547013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e2177005-ce82-4c36-8064-8ef4116a01ca None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:06.548188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e2177005-ce82-4c36-8064-8ef4116a01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.565196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 823/1646] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:06.566580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.566880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.567167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.616340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:06.617140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.634726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 824/1647] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:06.638822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:06.655931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe129d-8cd0-47c1-af92-811127ba150e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:06.662560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:06.663626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.664057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.664970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] PATH_INFO: `/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.684315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 824/1648] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:06.686847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:06.691233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.730178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c24df-3370-48f0-8cd8-6cf88c8a04f9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:06.731722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=860e8d006098489b9d123549a2b4fe2c, user_id=cd89068b50b74d6bb0c18be4358def41, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:06.741512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:06.742333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:06.742684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:06.746499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:06.746499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:06.782529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:06.793521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:06.904503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 825/1649] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:06 2022] PUT /identity/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:06.905523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:06.909750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 825/1650] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:06 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:06.911083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:06.917391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:06.997516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dec99-7e60-49f2-8857-5fde717c89ce admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.093885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.094567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.094865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.095143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.095253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfc96d-a86e-432d-846a-6b63fc5b3bf6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.095856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:07.096160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.107776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.107776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.108194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.108547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.126860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.140920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.177905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 826/1651] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:07.179161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.182248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.193805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 826/1652] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:07.195268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.201434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d163-e8f0-4fb2-bea8-500f1e963f4b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.211740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56664-783a-4a18-8ac5-b6b0f1e16529 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.216401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.217121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.217518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.218060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.218741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.218877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.219607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.219912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.220204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.221727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.271797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.274236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.299328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 827/1653] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:07.300206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.311813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:07.424548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 827/1654] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:07 2022] POST /identity/v3/users => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:07.425462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.436838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5926-19c8-48df-ac73-99341318c119 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.450532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.451386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.451784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.452239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.453002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.508790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.520575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b45e10-38d4-44d1-953b-a51fe619783d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.540496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.541269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.541688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.542277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.654070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 828/1655] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:07.654904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.672318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.711016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.747013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 828/1656] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:18:07.774578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.794308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac277085-1bf6-44a4-a830-b5042585f19d service swift] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.857386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371d93e-fce3-42bd-be82-87d6548d8f18 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.877583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.878493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.878783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.879081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] PATH_INFO: `/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.886806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=860e8d006098489b9d123549a2b4fe2c, user_id=cd89068b50b74d6bb0c18be4358def41, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.907983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.909052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.910661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.911425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.912560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:07.942441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.960476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 829/1657] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:07.961632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:07.972362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85fd7-6b99-4c70-96f7-8a8cd98d7977 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:07.980718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:07.981762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:07.982603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:07.983095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:07.986163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:07.987658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.017855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 829/1658] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:07 2022] PUT /identity/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:08.020821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:08.021595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:08.148300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 830/1659] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:07 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:08.148300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:08.198994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78937afe-8bcd-4aa5-ae26-41de60e41426 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:08.316782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f1f6-fdfa-436b-933c-1fcc4024c7ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:08.346140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:08.353212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:08.353579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:08.353875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] PATH_INFO: `/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:08.417729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad2e55ba2ad4190acc860d8263fc83f, user_id=3c1883547374415cb179d61a20a957b5, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.432482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:08.433517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:08.434173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:08.434931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:08.436013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.500446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:08.530396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:08.553626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 831/1660] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:08.554685 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:08.610653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5ba5-cbf9-468d-a2f2-71f97c7e3967 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:08.613774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 830/1661] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:08 2022] PUT /identity/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:08.614957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:08.770155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:08.772737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:08.773027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:08.773241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:08.775191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.834816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:08.837092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e50bc0-3373-4452-9b53-3fe69874929a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:08.848159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:08.849598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:08.849896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:08.850213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] PATH_INFO: `/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:08.855954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860e8d006098489b9d123549a2b4fe2c, user_id=cd89068b50b74d6bb0c18be4358def41, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.859264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 832/1662] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:08.859947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:08.884404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234376-e4ee-42f3-91fe-dfe38c990adc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:08.897723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:08.898578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:08.899336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:08.900171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:08.901870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:08.919094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:08.995220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 831/1663] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:08 2022] PUT /identity/v3/projects/860e8d006098489b9d123549a2b4fe2c/users/cd89068b50b74d6bb0c18be4358def41/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:08.996131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:09.000824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7d2d-5e6d-4e50-9895-6eb55dbfcdaf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:09.034569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 833/1664] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:09.042258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e5bb2-a6a6-4312-9386-1ec6069451b9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.042627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e5bb2-a6a6-4312-9386-1ec6069451b9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.042985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e5bb2-a6a6-4312-9386-1ec6069451b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.143834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a47e5bb2-a6a6-4312-9386-1ec6069451b9 None None] MFA Rules not processed for user `00df2776f7024acc888a4c9b2e1cc891`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:09.149627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a47e5bb2-a6a6-4312-9386-1ec6069451b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:09.188688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fdf61-24f2-4f2e-a41d-b6fc827e48a0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:09.213552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:09.218281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.219883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.220486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] PATH_INFO: `/v3/projects/842434a450c8442d93aff37b14d720a5/users/22b1af21f169460094629032cd03bd96/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.261264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 834/1665] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:09.269404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.270159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.270751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.295281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842434a450c8442d93aff37b14d720a5, user_id=22b1af21f169460094629032cd03bd96, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:09.323236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] MFA Rules not processed for user `cd89068b50b74d6bb0c18be4358def41`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:09.324481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:09.405804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:09.566146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 835/1666] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:09.569853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:09.571659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 832/1667] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:08 2022] PUT /identity/v3/projects/842434a450c8442d93aff37b14d720a5/users/22b1af21f169460094629032cd03bd96/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:09.572770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:09.581661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:09.590277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5d50-322e-45a5-9a8f-4014b4878ac3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:09.788337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02fa55-36a2-4b5f-b7da-6ecb1bee5ef1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:09.794480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:09.795301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:09.795603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.795986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.796367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] PATH_INFO: `/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.796505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.796951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.797409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.800036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad2e55ba2ad4190acc860d8263fc83f, user_id=3c1883547374415cb179d61a20a957b5, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:09.852824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa052c-d85c-4314-a54b-6a1a0db25114 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:09.874907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 836/1668] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:09 2022] PUT /identity/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:09.879301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329e7f-ce53-4523-810b-99fde67adcb7 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:09.879659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329e7f-ce53-4523-810b-99fde67adcb7 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:09.880058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329e7f-ce53-4523-810b-99fde67adcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:09.916114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:09.983022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-23329e7f-ce53-4523-810b-99fde67adcb7 None None] MFA Rules not processed for user `22b1af21f169460094629032cd03bd96`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:09.983371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:09.984141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-23329e7f-ce53-4523-810b-99fde67adcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:10.039191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 833/1669] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:10.040206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:10.042786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:10.188414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 837/1670] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:10.189591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:10.189992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:10.190379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:10.232854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ca8-3210-4c4f-8fd0-fb022168f3ad service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:10.237719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:10.241357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:10.370164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:10.370722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:10.370823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:10.371155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:10.371826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 838/1671] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Apr 6 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:10.374399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:10.378108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:10.487147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:10.523962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:10.526849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a6629-4562-450e-adce-54d8b8ff3648 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:10.539973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 834/1672] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:10 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:10.541207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:10.544703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:10.546680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:10.548850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:10.549286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] PATH_INFO: `/v3/projects/3139a718521744158d655456f3529f58` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:10.551940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3139a718521744158d655456f3529f58)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:10.555703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566547-068d-4b06-80d5-5701008df8c4 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:10.562010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:10.562672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:10.562964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:10.563316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:10.564276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:10.602573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c3fcb-27f0-408a-a0dd-77c364c9bf41 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:10.603456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:10.621527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 835/1673] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:10.628174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:10.628642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:10.632256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:10.704470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] MFA Rules not processed for user `279b268212d54d95b10267e7658722df`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:10.707407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:10.846576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3139a718521744158d655456f3529f58', 'request_id': 'req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:10.868388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 836/1674] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:10.869676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:10.881377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e4c4a-d722-4ece-94c0-3b97231f287a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:10.910566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3139a718521744158d655456f3529f58', 'request_id': 'req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:10.933968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3139a718521744158d655456f3529f58', 'request_id': 'req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:11.006709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:11.007471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.007770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.008054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.024032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] The token cache is being invalidate because project 3139a718521744158d655456f3529f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:11.024310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:11.025415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:11.028253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 839/1675] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:10 2022] DELETE /identity/v3/projects/3139a718521744158d655456f3529f58 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:11.029012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:11.040030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:11.050199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.169095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:11.211680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 837/1676] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:10 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:11.217895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:11.225283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.252654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee6468-0d30-4bc9-98f1-71dc0929a3b4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:11.268336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:11.269864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.270396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.270896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] PATH_INFO: `/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.276566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad2e55ba2ad4190acc860d8263fc83f, user_id=3c1883547374415cb179d61a20a957b5, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:11.346347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5394b-4084-4d16-b964-2857792dad01 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:11.435412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 840/1677] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:11 2022] PUT /identity/v3/projects/fad2e55ba2ad4190acc860d8263fc83f/users/3c1883547374415cb179d61a20a957b5/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:11.436798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b719-e46e-4eb6-8a66-9e39303152e4 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.437097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b719-e46e-4eb6-8a66-9e39303152e4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.440604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b719-e46e-4eb6-8a66-9e39303152e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.468614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496ae67-d91e-468e-88cb-2ae740445dd1 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:11.528821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-07f9b719-e46e-4eb6-8a66-9e39303152e4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:11.534579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-07f9b719-e46e-4eb6-8a66-9e39303152e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.653821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:11.654459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.654753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.655615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.668691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.756155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 841/1678] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:11.757286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.757581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.757864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.818834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:11.853427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec1e70-2696-4755-a5c2-ad84d452f147 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:11.875763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 838/1679] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:11.877527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:11.878064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:11.878828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:11.897512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] MFA Rules not processed for user `3c1883547374415cb179d61a20a957b5`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:11.899454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.940604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:11.944390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:11.968722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 839/1680] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:11.970017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:11.972820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:12.020650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743419bd-b3cb-4ca7-b02c-317759ec3ed2 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:12.039654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:12.043318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:12.043996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:12.044478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:12.050205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:12.171951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 842/1681] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:12.174246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.218152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d866a8-0cf0-41fd-b562-dcb0d9fee0d3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:12.236200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:12.238649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:12.238958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:12.247257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:12.247257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:12.247257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:12.265908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:12.311973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:12.314358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:12.326552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 840/1682] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:12.328098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.329664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:12.352060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 843/1683] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:12.352776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.358315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:12.386135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43a311-30ec-4795-92b1-f05fa9a7c812 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:12.400440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:12.401455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:12.401750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:12.402058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] PATH_INFO: `/v3/users/2baa9d8675bc48feab510bce45a01c66` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:12.403248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2baa9d8675bc48feab510bce45a01c66)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:12.474041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:12.497459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f633c-22ec-4bf0-b4b9-12b38515203b service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:12.510287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:12.511285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:12.511718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:12.512103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:12.532593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:12.572345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:12.586661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 841/1684] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3763 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:12.587927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.605773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504429f5-cfa5-41ac-bb32-d98a8a7c360c service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:12.616840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:12.619451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:12.619823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:12.620171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:12.621356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:12.685087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:12.775132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2baa9d8675bc48feab510bce45a01c66'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:12.791630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2baa9d8675bc48feab510bce45a01c66'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:12.826766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 842/1685] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:12 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:12.832348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.874353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2baa9d8675bc48feab510bce45a01c66'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:12.901921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2baa9d8675bc48feab510bce45a01c66'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:12.903135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2baa9d8675bc48feab510bce45a01c66'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:12.917854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 844/1686] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:12 2022] DELETE /identity/v3/users/2baa9d8675bc48feab510bce45a01c66 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:12.919087 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:12.922980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.050862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75548d-25dd-4200-8a52-a2c19be9e132 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:13.204999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511132d-7638-45c4-9764-f04dc1b80702 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:13.216052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:13.216290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:13.217833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.218753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.219212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.219772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.220268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.221735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] PATH_INFO: `/v3/users/37cebf9ec09d48fe800ba01bfc613e6a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.222372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:13.224167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cebf9ec09d48fe800ba01bfc613e6a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:13.285607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6d36-ee4d-4abe-8f9a-af391e715630 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:13.313151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:13.388912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 843/1687] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:12 2022] POST /identity/v3/users => generated 290 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:13.388912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073731-7e38-4ddd-b6ab-d5a6c47c66e2 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.388912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073731-7e38-4ddd-b6ab-d5a6c47c66e2 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.388912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073731-7e38-4ddd-b6ab-d5a6c47c66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.425530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-09073731-7e38-4ddd-b6ab-d5a6c47c66e2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:13.425530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-09073731-7e38-4ddd-b6ab-d5a6c47c66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.433001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 844/1688] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:13.434307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.434726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.435022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.492041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] MFA Rules not processed for user `16774d5cebcc40d8aea59afa90926050`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:13.494400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.577696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cebf9ec09d48fe800ba01bfc613e6a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:13.609912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cebf9ec09d48fe800ba01bfc613e6a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:13.683077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 845/1689] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:13.704342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:13.706178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.707857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cebf9ec09d48fe800ba01bfc613e6a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:13.731168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29741-fa2f-4f6d-b0fa-260b8eda8372 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:13.738145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:13.755606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.756044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.756648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.758769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:13.759020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cebf9ec09d48fe800ba01bfc613e6a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:13.761337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cebf9ec09d48fe800ba01bfc613e6a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:13.776798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 845/1690] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:12 2022] DELETE /identity/v3/users/37cebf9ec09d48fe800ba01bfc613e6a => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:13.779155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:13.783159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.813540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494115b9-1a26-4795-8f71-eaa6e908179e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:13.831415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 846/1691] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:13.831415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179d29-bdc3-46c0-95f7-86d698705d06 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.831415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179d29-bdc3-46c0-95f7-86d698705d06 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.831415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179d29-bdc3-46c0-95f7-86d698705d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.916704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3b179d29-bdc3-46c0-95f7-86d698705d06 None None] MFA Rules not processed for user `16774d5cebcc40d8aea59afa90926050`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:13.919286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3b179d29-bdc3-46c0-95f7-86d698705d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:13.947399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d1f3-221e-4e01-8bc4-b26425c80855 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:13.951003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:13.951668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:13.957213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:13.957213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:13.957213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.051790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:14.100869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:14.112811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 846/1692] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:14.114953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:14.116584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.135204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99e944-3bd8-43ad-9ba6-515f039bb3b1 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:14.148422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:14.149923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:14.150185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:14.150472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] PATH_INFO: `/v3/users/22b1af21f169460094629032cd03bd96` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:14.160826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b1af21f169460094629032cd03bd96)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:14.160982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 847/1693] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:14.161515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:14.161515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:14.163034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:14.218225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:14.219626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.224026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:14.241563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 848/1694] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:14.242631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:14.245377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.275321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040617-bc7a-4d5c-96db-239ca96d6ad9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:14.290010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:14.291558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:14.291863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:14.292153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] PATH_INFO: `/v3/projects/a2aef262e7554baf9e522ca5f04e3c65/users/53b58248fd95432d93fd0832776b7570/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:14.326737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2aef262e7554baf9e522ca5f04e3c65, user_id=53b58248fd95432d93fd0832776b7570, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:14.364798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:14.513797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 849/1695] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:14 2022] PUT /identity/v3/projects/a2aef262e7554baf9e522ca5f04e3c65/users/53b58248fd95432d93fd0832776b7570/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:14.513797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:14.516106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.614210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b1af21f169460094629032cd03bd96'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:14.642301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b1af21f169460094629032cd03bd96'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:14.732843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f1202-5515-433f-ab5a-fc5bbde4408e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:14.735672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b1af21f169460094629032cd03bd96'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:14.753752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:14.756142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b1af21f169460094629032cd03bd96'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:14.756732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:14.759361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:14.759789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b1af21f169460094629032cd03bd96'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:14.759901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:14.761850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.792123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 847/1696] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:14 2022] DELETE /identity/v3/users/22b1af21f169460094629032cd03bd96 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:14.792123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:14.798519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:14.979225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:15.023436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74bf9-dc82-4e61-abe4-b9049e372a03 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:15.044676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:15.045739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.046020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.047000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.050001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683f116-9c45-4b22-b280-42b7949729fc service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:15.053122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.100462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 850/1697] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:14 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:15.107735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87d79-f25d-4553-9fbe-cd27073e23eb None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.108268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87d79-f25d-4553-9fbe-cd27073e23eb None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.109450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87d79-f25d-4553-9fbe-cd27073e23eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.232577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a5a87d79-f25d-4553-9fbe-cd27073e23eb None None] MFA Rules not processed for user `53b58248fd95432d93fd0832776b7570`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:15.238064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a5a87d79-f25d-4553-9fbe-cd27073e23eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.295020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:15.352991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d60a1-2d9d-4d89-83d1-7dce69bd3fb2 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:15.375906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 848/1698] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:15.378133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa40ba-fe41-4e43-9530-e1917d921c6a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.379907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa40ba-fe41-4e43-9530-e1917d921c6a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.380929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa40ba-fe41-4e43-9530-e1917d921c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.405783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 851/1699] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:15.407443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.407868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.408279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.410464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 852/1700] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:15.413371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:15.418877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.427078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b1aa40ba-fe41-4e43-9530-e1917d921c6a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:15.428569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b1aa40ba-fe41-4e43-9530-e1917d921c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.437808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 849/1701] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:15.446482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd69e-f582-4ca3-888d-e4fe1154498d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:15.452498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:15.453061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.453420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.453781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.454700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:15.466158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.466848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.466848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:15.500029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:15.504448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:15.507126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.656365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 853/1702] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:15 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:15.658681 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:15.660604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:15.790525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 850/1703] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:18:15.792947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:15.829596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053329c-d877-42ae-a187-b7b43a15ce39 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:15.925410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e2b-200c-4097-b03d-0c58705f5b32 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:15.938879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:15.939494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:15.939845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:15.940168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:16.028617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:16.029267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:16.029542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:16.029807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:16.030487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:16.110151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:16.126434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:16.191304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:16.205006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 854/1704] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:16.205659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:16.209342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:16.231826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76c2b-d8de-4239-a5e7-1221c969a106 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:16.251994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 851/1705] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:15 2022] POST /identity/v3/users => generated 296 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:16.251994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:16.254764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:16.257161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:16.258008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:16.259093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:16.259399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] PATH_INFO: `/v3/projects/b3726372697e4e96aa61890e5fd0c74f` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:16.261959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3726372697e4e96aa61890e5fd0c74f)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:16.340828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:16.545600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7145c92-0275-47ec-9ae6-0387cf912094 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:16.572149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:16.575751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:16.577235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:16.577235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:16.588700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:16.655752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3726372697e4e96aa61890e5fd0c74f', 'request_id': 'req-09db0443-e087-4424-8ecb-007612e03135'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:16.681963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:16.717515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 852/1706] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:16 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:16.718649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:16.752599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c3ec3-0942-4ae1-8bb0-6be7f32b1a47 service nova] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:16.789062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3726372697e4e96aa61890e5fd0c74f', 'request_id': 'req-09db0443-e087-4424-8ecb-007612e03135'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:16.819445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3726372697e4e96aa61890e5fd0c74f', 'request_id': 'req-09db0443-e087-4424-8ecb-007612e03135'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:16.854307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] The token cache is being invalidate because project b3726372697e4e96aa61890e5fd0c74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:16.855912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:16.859834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:16.874256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 855/1707] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:16 2022] DELETE /identity/v3/projects/b3726372697e4e96aa61890e5fd0c74f => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:16.875511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:16.877874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:17.088041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:17.088880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:17.089173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:17.091699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:17.092968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:17.128960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db0443-e087-4424-8ecb-007612e03135 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:17.143131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:17.144486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:17.144989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:17.145481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] PATH_INFO: `/v3/users/cd89068b50b74d6bb0c18be4358def41` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:17.149191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd89068b50b74d6bb0c18be4358def41)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:17.188296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:17.207827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:17.236882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 853/1708] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:17.252784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:17.258580 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:17.302109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c54ca-943b-4dec-9d9e-d455a542f15f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:17.321672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:17.322586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:17.322883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:17.323503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] PATH_INFO: `/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:17.403137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aa3401bbf7422f85960c6a07271231, user_id=13806f5ff2c7429493e0c43926fd5391, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:17.461418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd89068b50b74d6bb0c18be4358def41'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:17.499129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:17.566794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd89068b50b74d6bb0c18be4358def41'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:17.590138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd89068b50b74d6bb0c18be4358def41'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:17.595382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 854/1709] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:17 2022] PUT /identity/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:17.600100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:17.616410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:17.657421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd89068b50b74d6bb0c18be4358def41'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:17.660027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd89068b50b74d6bb0c18be4358def41'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:17.682727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 856/1710] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:16 2022] DELETE /identity/v3/users/cd89068b50b74d6bb0c18be4358def41 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:17.684034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:17.686919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:17.849736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc516d-eda3-4ddf-9629-130778248b6e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:17.859031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:17.860595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:17.861128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:17.861504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:17.862503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:17.872317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72524a9-2f39-4cab-8bcc-ac32b1cc2824 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:17.886978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:17.888746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:17.890714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:17.891329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] PATH_INFO: `/v3/projects/99fca67de7774edcbd6cde7d0a6afdb4` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:17.894183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fca67de7774edcbd6cde7d0a6afdb4)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:17.904021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:17.967570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 857/1711] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:17.977392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:17.979340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:18.024459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcce60-b82c-41da-83a0-c621703e9c14 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:18.041510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:18.047053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:18.049363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:18.049606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] PATH_INFO: `/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:18.061632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aa3401bbf7422f85960c6a07271231, user_id=13806f5ff2c7429493e0c43926fd5391, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:18.117032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:18.156543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 858/1712] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:17 2022] PUT /identity/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:18.165249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:18.226489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fca67de7774edcbd6cde7d0a6afdb4', 'request_id': 'req-d4f41a0e-336f-4bdf-be8a-48966ea3e728'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:18.263061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fca67de7774edcbd6cde7d0a6afdb4', 'request_id': 'req-d4f41a0e-336f-4bdf-be8a-48966ea3e728'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:18.275026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fca67de7774edcbd6cde7d0a6afdb4', 'request_id': 'req-d4f41a0e-336f-4bdf-be8a-48966ea3e728'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:18.369854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] The token cache is being invalidate because project 99fca67de7774edcbd6cde7d0a6afdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:18.370012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:18.371767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:18.372939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe75035-fac0-4cd3-83ee-17dbd168edfe admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:18.376852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 855/1713] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:17 2022] DELETE /identity/v3/projects/99fca67de7774edcbd6cde7d0a6afdb4 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:18.378365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:18.382224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:18.549587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:18.550249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:18.550541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:18.550821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:18.551530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:18.604332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f41a0e-336f-4bdf-be8a-48966ea3e728 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:18.625208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:18.627325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:18.627325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:18.627586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] PATH_INFO: `/v3/users/3c1883547374415cb179d61a20a957b5` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:18.633860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1883547374415cb179d61a20a957b5)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:18.696202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:18.733990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:18.746481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 859/1714] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:18.747578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:18.756195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:18.803584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a1244-cc62-40e7-8351-9fc26c7baa38 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:18.832885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:18.834108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:18.834544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:18.834964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] PATH_INFO: `/v3/projects/842434a450c8442d93aff37b14d720a5` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:18.836894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=842434a450c8442d93aff37b14d720a5)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:18.911790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:19.035510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1883547374415cb179d61a20a957b5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.047749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1883547374415cb179d61a20a957b5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.120656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1883547374415cb179d61a20a957b5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.149255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842434a450c8442d93aff37b14d720a5', 'request_id': 'req-7505c45e-dde1-41f8-8136-624b8da050ec'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.155004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1883547374415cb179d61a20a957b5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.158707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1883547374415cb179d61a20a957b5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.188972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 856/1715] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:18 2022] DELETE /identity/v3/users/3c1883547374415cb179d61a20a957b5 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:19.189584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:19.195604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:19.228549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842434a450c8442d93aff37b14d720a5', 'request_id': 'req-7505c45e-dde1-41f8-8136-624b8da050ec'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.258980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842434a450c8442d93aff37b14d720a5', 'request_id': 'req-7505c45e-dde1-41f8-8136-624b8da050ec'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.295376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] The token cache is being invalidate because project 842434a450c8442d93aff37b14d720a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:19.295752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.296513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7505c45e-dde1-41f8-8136-624b8da050ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:19.301415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 860/1716] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:18 2022] DELETE /identity/v3/projects/842434a450c8442d93aff37b14d720a5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:19.306309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8ad4-7534-47e1-8383-014200914332 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:19.306602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8ad4-7534-47e1-8383-014200914332 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:19.306931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8ad4-7534-47e1-8383-014200914332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:19.346682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-364a8ad4-7534-47e1-8383-014200914332 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:19.347846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-364a8ad4-7534-47e1-8383-014200914332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:19.434546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9598e-b818-4d4e-a4e5-c6cfa816e224 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:19.455568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:19.456485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:19.456714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:19.457103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] PATH_INFO: `/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:19.467645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 861/1717] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:19.467824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9aa3401bbf7422f85960c6a07271231, user_id=13806f5ff2c7429493e0c43926fd5391, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:19.471424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83cc7-ec82-4050-8028-87641d8389c1 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:19.471424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83cc7-ec82-4050-8028-87641d8389c1 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:19.471424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83cc7-ec82-4050-8028-87641d8389c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:19.509596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-05b83cc7-ec82-4050-8028-87641d8389c1 None None] MFA Rules not processed for user `16774d5cebcc40d8aea59afa90926050`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:19.511967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-05b83cc7-ec82-4050-8028-87641d8389c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:19.553453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38531-3dee-43f1-a53b-bea7f0d55f58 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:19.651664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 862/1718] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:19.655934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:19.655934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:19.656680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:19.732794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 857/1719] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:19 2022] PUT /identity/v3/projects/b9aa3401bbf7422f85960c6a07271231/users/13806f5ff2c7429493e0c43926fd5391/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:19.744099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:19.744751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:19.745260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:19.865259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] MFA Rules not processed for user `13806f5ff2c7429493e0c43926fd5391`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:19.868010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:20.024619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 858/1720] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:20.036248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:20.039101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:20.039435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:20.040807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:20.201767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 863/1721] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:20.206142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:20.267165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e72d25-5144-49d5-974d-97ced3ed17e6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:20.449904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:20.449904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:20.449904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:20.449904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:20.451600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:20.451600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:20.451600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:20.452508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1e80-193c-4fb3-be91-7518e6b6636d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:20.452508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:20.452508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:20.452508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:20.453306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:20.453375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 864/1722] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:20.453444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:20.453444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:20.453444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 859/1723] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:20 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:20.453626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:20.453626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666c22-5972-4312-bbe2-bf92d360d22c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:20.453626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:20.453626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:20.453886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:20.453886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:20.453886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:20.476664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:20.520806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:20.523695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:20.540413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dc02e-5918-4396-8994-a1acbddd38b4 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:20.546227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:20.547252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:20.547661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:20.548061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] PATH_INFO: `/v3/projects/860e8d006098489b9d123549a2b4fe2c` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:20.549446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] RBAC: Authorizing `identity:delete_project(project_id=860e8d006098489b9d123549a2b4fe2c)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:20.588057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:21.366950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 865/1724] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:20 2022] POST /identity/v3/projects => generated 373 bytes in 946 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:21.371520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:21.480015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875954ab-a429-4652-9df3-887edcf79a59 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:21.488180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:21.488932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:21.489773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:21.490133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:21.490878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:21.518658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:21.762504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860e8d006098489b9d123549a2b4fe2c', 'request_id': 'req-5a0d9caa-2182-454c-b440-df254b65438c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:21.776032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860e8d006098489b9d123549a2b4fe2c', 'request_id': 'req-5a0d9caa-2182-454c-b440-df254b65438c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:21.781455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860e8d006098489b9d123549a2b4fe2c', 'request_id': 'req-5a0d9caa-2182-454c-b440-df254b65438c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:21.825717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 866/1725] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:21 2022] POST /identity/v3/users => generated 287 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:21.832133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:21.855457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe37b4-f0fc-41a3-bfd9-2db23c3e4c0f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:21.914370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] The token cache is being invalidate because project 860e8d006098489b9d123549a2b4fe2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:21.914721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:21.915980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:21.918157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 860/1726] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:20 2022] DELETE /identity/v3/projects/860e8d006098489b9d123549a2b4fe2c => generated 0 bytes in 1400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:21.919338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:21.921719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:21.965469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:21.966216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:21.967251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:21.967608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:21.969487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.001225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd771-410e-497d-b36f-057b5dd56a99 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.019731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 867/1727] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:22.041177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.042611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.044254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.075264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:22.076595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.089092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d9caa-2182-454c-b440-df254b65438c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.091193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 868/1728] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:22.092238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.099707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.099841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.099841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.099841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.099841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.100178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.106234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceebf3e-8d9b-4e53-b776-6b86fad50d89 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.110624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.111620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.111917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.112200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] PATH_INFO: `/v3/projects/97c1d04f6a3c4ab1a8abdfc92fc9f73a/users/ad5b92d746924aab9a3d9b9d0b27fdc4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.141702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c1d04f6a3c4ab1a8abdfc92fc9f73a, user_id=ad5b92d746924aab9a3d9b9d0b27fdc4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.173344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.175487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fe636-802b-4fe2-bafd-85e98e39921e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.198454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb2bae-b194-47d1-8499-f3c4e32c4656 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.207729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 861/1729] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:21 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:22.210284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.210284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.210560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.235494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:22.236819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.248111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 862/1730] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:22.249537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.266520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 869/1731] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:22 2022] PUT /identity/v3/projects/97c1d04f6a3c4ab1a8abdfc92fc9f73a/users/ad5b92d746924aab9a3d9b9d0b27fdc4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:22.267836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51594db-07f0-427e-a2b1-53a60e799644 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.270933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1393a-a670-4bbc-9ea9-3cd889908276 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.271242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1393a-a670-4bbc-9ea9-3cd889908276 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.271691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1393a-a670-4bbc-9ea9-3cd889908276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.317843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-76f1393a-a670-4bbc-9ea9-3cd889908276 None None] MFA Rules not processed for user `ad5b92d746924aab9a3d9b9d0b27fdc4`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:22.319283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-76f1393a-a670-4bbc-9ea9-3cd889908276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.340463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.341072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.341360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.341644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.342372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:22.344358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.370299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.383130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 863/1732] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:22.384118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.387480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.402055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11026ac-06c7-4266-af09-81cb46727a6e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.408831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 870/1733] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:22.410018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c3d-a879-49ac-b01d-907f910814d5 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.410320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c3d-a879-49ac-b01d-907f910814d5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.410609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c3d-a879-49ac-b01d-907f910814d5 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.412835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 871/1734] 10.222.0.11 () {54 vars in 912 bytes} [Wed Apr 6 10:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:22.413617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d28c3d-a879-49ac-b01d-907f910814d5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.415408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.416217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.416506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.416788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] PATH_INFO: `/v3/projects/fad2e55ba2ad4190acc860d8263fc83f` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.418391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad2e55ba2ad4190acc860d8263fc83f)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.427000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d28c3d-a879-49ac-b01d-907f910814d5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.432095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.436166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.436166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.436166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.436166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.444232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.460907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.597556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 872/1735] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:22.597556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.717220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976e252-9fd7-4235-b49f-7af02ab8cb80 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:22.735260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad2e55ba2ad4190acc860d8263fc83f', 'request_id': 'req-429df493-44ba-454d-b677-62a27648f2d0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:22.753261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad2e55ba2ad4190acc860d8263fc83f', 'request_id': 'req-429df493-44ba-454d-b677-62a27648f2d0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:22.760960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad2e55ba2ad4190acc860d8263fc83f', 'request_id': 'req-429df493-44ba-454d-b677-62a27648f2d0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:22.791497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:22.792123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.797233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.797233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.797233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:22.825622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:22.872723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] The token cache is being invalidate because project fad2e55ba2ad4190acc860d8263fc83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:22.873289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:22.874354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-429df493-44ba-454d-b677-62a27648f2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:22.877631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 864/1736] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:22 2022] DELETE /identity/v3/projects/fad2e55ba2ad4190acc860d8263fc83f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:22.879665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b870d0-df72-4179-bb1a-7a6b564fed63 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.880726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b870d0-df72-4179-bb1a-7a6b564fed63 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.881146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b870d0-df72-4179-bb1a-7a6b564fed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:22.906952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a2b870d0-df72-4179-bb1a-7a6b564fed63 None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:22.911095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a2b870d0-df72-4179-bb1a-7a6b564fed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.945378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 873/1737] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:22.948219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:22.951708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:22.985596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 865/1738] 10.222.0.11 () {58 vars in 1009 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:22.987013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:22.997842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:22.998192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.065314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:23.066636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.103110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652293eb-c681-4b5f-bf23-59445b1280f2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.109287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.110564 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.111570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.112082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.113208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.147341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.152208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 866/1739] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:23.159080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.160363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.172774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52042b-6471-4c54-a699-31f16eaa906c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.177887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.178721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.178950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.179233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.180640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.207631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953a26-8ebd-476a-9d06-c7f34b3e3563 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.324990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 874/1740] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:22 2022] POST /identity/v3/users => generated 293 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:23.326071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.327757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.347679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 867/1741] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:23 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:23.352018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.352018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.352018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.382173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:23.383424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.391563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 868/1742] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:23.397548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.408265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcb17-7297-43c2-bda7-54e8ea3a9b55 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.409250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9e1b-983b-4bbe-a281-59c68a7c357c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.412090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.412759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.413150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.413454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.415891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.416647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.416927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.417235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.417987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.421090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.447713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786dff6-8b0d-468c-92af-14c1407eb8f2 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.448245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.456931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 875/1743] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:23 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:23.458765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.458990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.459269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.460940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 869/1744] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:23.461798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.475974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45923c-7d3c-42dd-af71-628f7235d0e8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.480632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.481246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.481534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.481820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.482563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.487193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] MFA Rules not processed for user `279b268212d54d95b10267e7658722df`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:23.488352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.512101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.531839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 870/1745] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:23.533049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.543215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fa36-3f4c-46c3-9e73-2c2681b48a8c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.547552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.548141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.548431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.548712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.549408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:23.549703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.571240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 876/1746] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:23.572287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.575848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.585839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5ef7-e154-4afd-9b02-e77a21344be1 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.590378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.591118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.591407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.591727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] PATH_INFO: `/v3/projects/488455ec6f44428fa619cc789871b4d6/users/45166b97976d4976a80009bf51552cc3/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.594184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 871/1747] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:23.594184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.605453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c6d99-625c-48b8-8ff2-2b69322ade53 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.609287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:23.610512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.610897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.611216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] PATH_INFO: `/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.613372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488455ec6f44428fa619cc789871b4d6, user_id=45166b97976d4976a80009bf51552cc3, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.634071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82cb36629b84ca1958225fe3c20fd63, user_id=83b1f7ce953f41b3842afb6c2f1f2d82, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:23.642782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.664229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44507caf-4530-4af4-9c2d-ea1d9d685b75 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:23.731787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 877/1748] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:23 2022] PUT /identity/v3/projects/488455ec6f44428fa619cc789871b4d6/users/45166b97976d4976a80009bf51552cc3/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:23.732826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:23.765830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 872/1749] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:23 2022] PUT /identity/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:23.772514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:23.772514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:23.772514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:23.814676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] MFA Rules not processed for user `45166b97976d4976a80009bf51552cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:23.816157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:23.860649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b36dd-e813-4652-ab92-6ea11b1e93f7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:23.926070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 873/1750] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:23.928084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.009541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.010772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.011116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.011413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.012046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.061566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b6140-bd23-48f9-a3d2-f7795308301b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.092765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1ea06-189f-41cf-9f5c-6553575a165e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.105180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.105956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.106618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.107022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.107932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.153950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.165756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 874/1751] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:24.166769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.168619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:24.179832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 878/1752] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:23 2022] POST /identity/v3/projects => generated 385 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:24.186898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.186898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.186898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.229186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] MFA Rules not processed for user `00df2776f7024acc888a4c9b2e1cc891`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:24.232661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:24.271956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c4e2-a9d9-43fd-9297-c0fc0deac3fd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.383937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.386805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.388246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.388591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.401756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 879/1753] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:24.403191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.526540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.579683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f351b5-efa4-4b39-96b7-5603ceddb0e9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.599568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.603289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.604921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.606715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.608010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] PATH_INFO: `/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.618130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82cb36629b84ca1958225fe3c20fd63, user_id=83b1f7ce953f41b3842afb6c2f1f2d82, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.627732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 875/1754] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:24 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:24.628856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.669116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07015c-019d-4d31-aab9-b1b5b5a49ddc service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.670626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.680606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.682430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.682844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.683288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.684099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.684727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 880/1755] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:24 2022] PUT /identity/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:24.688194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.719032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.784625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd337-081d-440f-ac66-90bf9ee69337 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.791585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.792475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.792901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.793260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] PATH_INFO: `/v3/users/45166b97976d4976a80009bf51552cc3` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.794524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45166b97976d4976a80009bf51552cc3)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.822843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.829329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 876/1756] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:24 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:24.830279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.863624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44851c-d1f6-4135-95e9-1c313832e0ed admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.888386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.889142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.889428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.889800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.890506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:24.950464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:24.968477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 877/1757] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:24.968477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:24.980001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36669f1b-8451-4634-86a7-353d64f77574 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:24.985485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:24.986526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:24.987288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:24.987925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:24.988839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:25.031067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:25.055978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 878/1758] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:25.055978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:25.095649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45166b97976d4976a80009bf51552cc3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:25.098050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d0bf5-e62f-476c-bc0d-7ed2f2938a2a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:25.126661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:25.134214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.134214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.134214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] PATH_INFO: `/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.134214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82cb36629b84ca1958225fe3c20fd63, user_id=83b1f7ce953f41b3842afb6c2f1f2d82, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:25.173524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956786-e5b9-4841-88e6-7a22d940c22e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:25.181821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45166b97976d4976a80009bf51552cc3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:25.193071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45166b97976d4976a80009bf51552cc3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:25.226714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45166b97976d4976a80009bf51552cc3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:25.227599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45166b97976d4976a80009bf51552cc3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:25.261703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 881/1760] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:24 2022] DELETE /identity/v3/users/45166b97976d4976a80009bf51552cc3 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:25.261703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:25.261703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:25.262877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 879/1760] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:25 2022] PUT /identity/v3/projects/b82cb36629b84ca1958225fe3c20fd63/users/83b1f7ce953f41b3842afb6c2f1f2d82/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:25.264782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249f2b-cae6-41ec-9ff2-bf7bf885de08 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.265385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249f2b-cae6-41ec-9ff2-bf7bf885de08 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.265808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249f2b-cae6-41ec-9ff2-bf7bf885de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.318608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b1249f2b-cae6-41ec-9ff2-bf7bf885de08 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:25.319774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b1249f2b-cae6-41ec-9ff2-bf7bf885de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:25.407342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8afeb-f4d0-435a-bbce-8fd3e5322ec5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:25.414359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:25.421599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.423346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.423821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] PATH_INFO: `/v3/projects/f0192e33b4fc4c6f9a9a99af785bffb8/users/789e7d9c7107456ebdc29654e7915689/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.435161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 880/1761] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:25.436727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.437045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.438360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.459378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0192e33b4fc4c6f9a9a99af785bffb8, user_id=789e7d9c7107456ebdc29654e7915689, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:25.483897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] MFA Rules not processed for user `83b1f7ce953f41b3842afb6c2f1f2d82`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:25.485067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:25.492648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:25.568439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 881/1762] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:25.569311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:25.573887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:25.642817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 882/1763] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:25 2022] PUT /identity/v3/projects/f0192e33b4fc4c6f9a9a99af785bffb8/users/789e7d9c7107456ebdc29654e7915689/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:25.645042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:25.645428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c78ca3-497f-4bd5-ac85-705ae3b0f7f3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:25.653215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:25.737762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:25.738414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.738684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.738967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.753471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0ef25-3c1b-4130-b491-da4889fd8281 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:25.758939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:25.759859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.760249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.760628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.828795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:25.846982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:25.855107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5745-5d70-45ba-817a-ff737d36bbe9 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:25.865562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 882/1764] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:25.866966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:25.867262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:25.867604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:25.873525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:25.888209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 883/1765] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:25 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:25.928248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] MFA Rules not processed for user `789e7d9c7107456ebdc29654e7915689`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:25.929807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:26.215452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 883/1766] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:26.220567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.242148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303991-1c90-449b-8910-f6f945e66c79 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:26.261539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:26.262213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:26.262586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:26.262845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:26.263502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:26.287421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.289302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:26.316813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4450-4ada-4fec-961a-7c637e38f9c6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:26.330669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:26.335263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:26.335263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:26.335263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:26.338152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:26.351239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:26.434711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:26.500758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:26.525487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 884/1767] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:26 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:26.533356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 884/1768] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:26.534544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.561523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631ca6c-81cc-44c5-b2d8-5a33a8ec78f5 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:26.706342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:26.707178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:26.707506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:26.708410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:26.709370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:26.750208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:26.794865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.797150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:26.831035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193a0b-d0b5-4b54-b4b4-d0fb6bca1ec7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:26.858710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:26.858710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:26.858710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:26.858710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] PATH_INFO: `/v3/projects/488455ec6f44428fa619cc789871b4d6` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:26.859006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488455ec6f44428fa619cc789871b4d6)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:26.894443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 885/1769] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:26 2022] POST /identity/v3/users => generated 299 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:26.896671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.897954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:26.907699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d84b-a304-4367-9877-8d3a6546284e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:26.912807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:26.913538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:26.913877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:26.914203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:26.914971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:26.941303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:26.970729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 886/1770] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:26.972081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:26.989021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4866e-78ea-4ee7-8328-41dd247c10b2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.059770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.059770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.059770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.059770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] PATH_INFO: `/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.111434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff5a90e4afc4ec8a8f7188a8df857cc, user_id=bfe2bf31b44d4acc8616080164850ac4, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.157008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.180526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488455ec6f44428fa619cc789871b4d6', 'request_id': 'req-56f3dcbf-b88c-4779-9288-37ebcf766ca5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:27.250738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488455ec6f44428fa619cc789871b4d6', 'request_id': 'req-56f3dcbf-b88c-4779-9288-37ebcf766ca5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:27.257673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 887/1771] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:26 2022] PUT /identity/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:27.261487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.268813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488455ec6f44428fa619cc789871b4d6', 'request_id': 'req-56f3dcbf-b88c-4779-9288-37ebcf766ca5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:27.279460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] The token cache is being invalidate because project 488455ec6f44428fa619cc789871b4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:27.279603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:27.281642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56f3dcbf-b88c-4779-9288-37ebcf766ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:27.282012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 885/1772] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:26 2022] DELETE /identity/v3/projects/488455ec6f44428fa619cc789871b4d6 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:27.310874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08fd6-537d-4c39-9f08-ae03c359eab6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.311228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08fd6-537d-4c39-9f08-ae03c359eab6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.313173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d08fd6-537d-4c39-9f08-ae03c359eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.376024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f1d08fd6-537d-4c39-9f08-ae03c359eab6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:27.380679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f1d08fd6-537d-4c39-9f08-ae03c359eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:27.397166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d608ce-7772-49c0-985e-72f67c964863 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.398915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 886/1773] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:27.403602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.404225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.404510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.405622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.405622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.413380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.413683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.413989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.439940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.457539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 888/1774] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:18:27.463709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.472566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:27.481023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:27.482449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:27.501074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 887/1775] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:18:27.505764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.507109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370af7-9cb0-44fe-9544-b9f3a8661544 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.511748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.513142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.513424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.513707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] PATH_INFO: `/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.515844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff5a90e4afc4ec8a8f7188a8df857cc, user_id=bfe2bf31b44d4acc8616080164850ac4, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.520775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1ae63-df69-4042-83a1-bb6392601cf1 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.541794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.543709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.544022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.552999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.553159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.553274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:27.553274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.556972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 889/1776] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:27 2022] PUT /identity/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:27.560552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.638750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.665578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 888/1777] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:18:27.667985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.674755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971160-4b4d-4f40-bced-aaa7246458b8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.682148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.682328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.682708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.683128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.684006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.710493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9846b-bb5d-4575-a448-177027ceca02 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.723718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.724606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.725024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.725317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.727413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.740660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.749453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 890/1778] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:27.750489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.761404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccafe8-2ac4-4da6-b5b7-9f59734b3996 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:27.762760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.766667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:27.767726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.770733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.770733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] PATH_INFO: `/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:27.771315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff5a90e4afc4ec8a8f7188a8df857cc, user_id=bfe2bf31b44d4acc8616080164850ac4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:27.814416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98804e7-f80c-4209-9882-6e28ad4caea3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:27.880509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 889/1779] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:27 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:27.884728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:27.955396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 891/1780] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:27 2022] PUT /identity/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc/users/bfe2bf31b44d4acc8616080164850ac4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:27.968959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:27.969455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:27.970162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.069036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] MFA Rules not processed for user `bfe2bf31b44d4acc8616080164850ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:28.070404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:28.105040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d126b-939c-4ce4-b171-e64574a43f0b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:28.228051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:28.228669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.229265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.229774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.230443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:28.255676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 892/1781] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:28.285629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:28.294263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:28.295992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:28.378689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f53c4-1220-466d-b1cd-2ef51dd677e0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:28.382763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:28.383424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.383778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.384127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.393269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:28.399812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 890/1782] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:27 2022] POST /identity/v3/users => generated 281 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:28.406289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:28.416199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b04b1-f9cb-4f76-b47a-a48d31f8dbc5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:28.418628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:28.420508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:28.421089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.421382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.421663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.422385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:28.429031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 893/1783] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:28 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:18:28.462890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37d87-b080-4a82-ace2-7449813c466c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:28.473742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 891/1784] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:18:28.478464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:28.489802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ad2f-4681-4eaa-b27b-c0497f39403d service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:28.494115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:28.494994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.495343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.495747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] PATH_INFO: `/v3/projects/5e37d7a5ed784a4096fecb2accfb28de/users/272e4f4c7a1444d0a078ab7dca9ce59e/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.521198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e37d7a5ed784a4096fecb2accfb28de, user_id=272e4f4c7a1444d0a078ab7dca9ce59e, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:28.556204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101198aa-3b5f-4c33-aec7-c3b4f1ccfda6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:28.671607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 894/1785] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:28 2022] PUT /identity/v3/projects/5e37d7a5ed784a4096fecb2accfb28de/users/272e4f4c7a1444d0a078ab7dca9ce59e/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:28.673264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d639d-2661-4315-87b2-8647d5b31e36 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.673565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d639d-2661-4315-87b2-8647d5b31e36 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.673838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d639d-2661-4315-87b2-8647d5b31e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.722572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-108d639d-2661-4315-87b2-8647d5b31e36 None None] MFA Rules not processed for user `272e4f4c7a1444d0a078ab7dca9ce59e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:28.724925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-108d639d-2661-4315-87b2-8647d5b31e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:28.798949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 892/1786] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3668 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:28.989306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8a2e-5df6-46de-945e-6d561da0bd7d None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.989645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8a2e-5df6-46de-945e-6d561da0bd7d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.989986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8a2e-5df6-46de-945e-6d561da0bd7d None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:28.991837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 895/1787] 10.222.0.11 () {54 vars in 961 bytes} [Wed Apr 6 10:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:28.998231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:28.998702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:28.998963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:29.028971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] MFA Rules not processed for user `125ce3f900a94e639c62b77d4f7d9c81`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:29.030220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:29.092331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 893/1788] 10.222.0.11 () {58 vars in 1058 bytes} [Wed Apr 6 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:18:29.100770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8a2e-5df6-46de-945e-6d561da0bd7d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:29.113857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8a2e-5df6-46de-945e-6d561da0bd7d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:29.117918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:29.119486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:29.120186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:29.120669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:29.131775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:29.160177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49496b-0f7d-46b5-8a1c-270808b4d40e service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:29.171604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 896/1789] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:29 2022] GET /identity/v3/auth/tokens => generated 3668 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:29.440188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:29.518313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a58db-ef15-4cb2-9c59-775cd2161b3d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:29.523747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:29.524557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:29.524843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:29.525124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] PATH_INFO: `/v3/users/272e4f4c7a1444d0a078ab7dca9ce59e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:29.526267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272e4f4c7a1444d0a078ab7dca9ce59e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:29.551858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:29.796788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272e4f4c7a1444d0a078ab7dca9ce59e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:29.872855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272e4f4c7a1444d0a078ab7dca9ce59e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:29.881759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272e4f4c7a1444d0a078ab7dca9ce59e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:29.893250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272e4f4c7a1444d0a078ab7dca9ce59e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:29.894124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272e4f4c7a1444d0a078ab7dca9ce59e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:29.900078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 894/1790] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:29 2022] DELETE /identity/v3/users/272e4f4c7a1444d0a078ab7dca9ce59e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:29.904890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:29.905349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:29.905478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:29.927939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:29.929120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:30.031039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 897/1791] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:30.040052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:30.041431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:30.194857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569c8f-d252-4c99-a3cf-742bd079f8c8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:30.198318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:30.198969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:30.199256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:30.202407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:30.209354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:30.238734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c582f55-bb37-43ea-afc2-068ff5733418 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:30.253660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 895/1792] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:30.277116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:30.277116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:30.296476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff2c5-5c87-4270-92f7-ac57c8edb65e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:30.303182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:30.304002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:30.304286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:30.304764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] PATH_INFO: `/v3/users/789e7d9c7107456ebdc29654e7915689` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:30.309535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] RBAC: Authorizing `identity:delete_user(user_id=789e7d9c7107456ebdc29654e7915689)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:30.365303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:30.582988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789e7d9c7107456ebdc29654e7915689'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:30.595758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789e7d9c7107456ebdc29654e7915689'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:30.698181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789e7d9c7107456ebdc29654e7915689'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:30.712985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789e7d9c7107456ebdc29654e7915689'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:30.713844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789e7d9c7107456ebdc29654e7915689'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:30.721576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 898/1793] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:30 2022] DELETE /identity/v3/users/789e7d9c7107456ebdc29654e7915689 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:30.726072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d95c7-32eb-4f40-9352-3c14f440a217 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:30.726632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d95c7-32eb-4f40-9352-3c14f440a217 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:30.727111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d95c7-32eb-4f40-9352-3c14f440a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:30.787391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-520d95c7-32eb-4f40-9352-3c14f440a217 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:30.788552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-520d95c7-32eb-4f40-9352-3c14f440a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:30.915719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 896/1794] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:30.994840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:30.999084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:31.161334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322618d-1537-4bca-b62b-8407c61d296a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:31.176984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:31.178135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:31.178903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:31.179325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:31.202273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:31.263442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fe05c-b9fb-416f-bab9-bfb56c393fbd service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:31.285260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 899/1795] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:31.972444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:31.973350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:31.973808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:31.975952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 897/1796] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:31.982569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:31.983086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:31.983503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:32.016302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:32.019239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:32.197729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 900/1797] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:32.531959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:32.536920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:32.556820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5f343-82bf-4312-8fca-7663d9b7e121 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:32.562623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:32.563263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:32.563708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:32.563999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:32.579089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:32.610605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:32.622608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 898/1798] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:32.641584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:32.643252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:32.657843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c00e-79df-4881-ac1d-c3b9b9432826 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:32.665518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:32.667692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:32.668618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:32.669342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] PATH_INFO: `/v3/projects/5e37d7a5ed784a4096fecb2accfb28de` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:32.670717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e37d7a5ed784a4096fecb2accfb28de)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:32.724454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:32.903310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e37d7a5ed784a4096fecb2accfb28de', 'request_id': 'req-98e480d6-1ed0-47b6-abae-a955b6eec66b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:32.932079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e37d7a5ed784a4096fecb2accfb28de', 'request_id': 'req-98e480d6-1ed0-47b6-abae-a955b6eec66b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:32.952749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e37d7a5ed784a4096fecb2accfb28de', 'request_id': 'req-98e480d6-1ed0-47b6-abae-a955b6eec66b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.014008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:33.014008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:33.043271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd6d49-19f6-4bf2-a40b-e02074cb38bc service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:33.075776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] The token cache is being invalidate because project 5e37d7a5ed784a4096fecb2accfb28de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:33.077291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.078578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-98e480d6-1ed0-47b6-abae-a955b6eec66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.088884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 901/1799] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:32 2022] DELETE /identity/v3/projects/5e37d7a5ed784a4096fecb2accfb28de => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:33.088884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe6b5-0292-4262-a2d5-df9e82af7394 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.088884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe6b5-0292-4262-a2d5-df9e82af7394 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.088884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe6b5-0292-4262-a2d5-df9e82af7394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.143369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c11fe6b5-0292-4262-a2d5-df9e82af7394 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:33.146944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c11fe6b5-0292-4262-a2d5-df9e82af7394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:33.243736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:33.244659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.245022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.245479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] PATH_INFO: `/v3/projects/f0192e33b4fc4c6f9a9a99af785bffb8` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.250452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0192e33b4fc4c6f9a9a99af785bffb8)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:33.320365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:33.365843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 902/1800] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:33.375724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.376143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.376533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.428020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:33.429356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:33.450315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 903/1801] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:33.459957 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:33.469852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c31c6-7fec-449a-9357-c3533a0a53e6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:33.505709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0192e33b4fc4c6f9a9a99af785bffb8', 'request_id': 'req-93bb7013-8c1f-4476-9844-7f4182c973f7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.600862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:33.601772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.602291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.609580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0192e33b4fc4c6f9a9a99af785bffb8', 'request_id': 'req-93bb7013-8c1f-4476-9844-7f4182c973f7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.612175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.613200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:33.616937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:33.622806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0192e33b4fc4c6f9a9a99af785bffb8', 'request_id': 'req-93bb7013-8c1f-4476-9844-7f4182c973f7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.644447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] The token cache is being invalidate because project f0192e33b4fc4c6f9a9a99af785bffb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:33.644843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.645595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.646013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:33.649174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 899/1802] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:33 2022] DELETE /identity/v3/projects/f0192e33b4fc4c6f9a9a99af785bffb8 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:33.654914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:33.657255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:33.672704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 904/1803] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:33.677641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:33.679755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:33.696815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f318e5-8586-4dc6-a2ea-f7e174da9cac admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:33.699917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb7013-8c1f-4476-9844-7f4182c973f7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:33.702643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:33.704005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.704498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.704919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.705021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:33.705802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:33.706103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:33.706468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:33.706818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] PATH_INFO: `/v3/users/bfe2bf31b44d4acc8616080164850ac4` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:33.708197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe2bf31b44d4acc8616080164850ac4)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:33.739988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:33.762991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:33.850506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 905/1804] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:33 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:33.854370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:33.983962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe2bf31b44d4acc8616080164850ac4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:33.986297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9a2c5-996b-4ca3-82f2-54b2eef02b47 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:34.000223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:34.000924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.001210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.004583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.004583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:34.061466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe2bf31b44d4acc8616080164850ac4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:34.070659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:34.074955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe2bf31b44d4acc8616080164850ac4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:34.089922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe2bf31b44d4acc8616080164850ac4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:34.090803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe2bf31b44d4acc8616080164850ac4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:34.102865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 900/1805] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:33 2022] DELETE /identity/v3/users/bfe2bf31b44d4acc8616080164850ac4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:34.188429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 906/1806] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:33 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:34.193240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:34.195028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:34.297369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77594f8-eaa0-4558-8013-ab37875f366e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:34.303276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:34.303888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.304213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.306069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.306069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:34.334242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d44715-a385-47f0-9c71-04b5a1435c69 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:34.345390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 901/1807] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:34.350200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:34.361369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543eed-4ce1-46a3-9d0d-7c77aac99fc6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:34.365796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:34.367357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.367357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.367357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] PATH_INFO: `/v3/projects/87a50096fc3440fda295425664e4f31e/users/413f056d52704104b5a09e55b797e7c4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.389557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a50096fc3440fda295425664e4f31e, user_id=413f056d52704104b5a09e55b797e7c4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:34.417577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:34.484640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 907/1808] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:34 2022] PUT /identity/v3/projects/87a50096fc3440fda295425664e4f31e/users/413f056d52704104b5a09e55b797e7c4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:34.488671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.489706 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.490158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.544029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] MFA Rules not processed for user `413f056d52704104b5a09e55b797e7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:34.546044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:34.664933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 902/1809] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:34.678181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:34.679993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:34.738287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:34.740459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:34.771054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0db3e2-f752-46ff-9527-cffd0afb2e77 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:34.777639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:34.778704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.783788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.783788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.791230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:34.820965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f2967-c352-4c21-ae20-622b64c871d1 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:34.831221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 908/1810] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:34.843397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736817c2-22af-4d73-a6b3-4c2f3cba70e9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:34.853293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:34.854516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:34.855006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:34.855577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] PATH_INFO: `/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:34.856887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff5a90e4afc4ec8a8f7188a8df857cc)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:34.885529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:35.039663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff5a90e4afc4ec8a8f7188a8df857cc', 'request_id': 'req-51d02c58-2139-4928-af43-e45f246257f2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:35.131150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff5a90e4afc4ec8a8f7188a8df857cc', 'request_id': 'req-51d02c58-2139-4928-af43-e45f246257f2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:35.153612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff5a90e4afc4ec8a8f7188a8df857cc', 'request_id': 'req-51d02c58-2139-4928-af43-e45f246257f2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:35.177291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] The token cache is being invalidate because project 6ff5a90e4afc4ec8a8f7188a8df857cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:35.177991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:35.181436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-51d02c58-2139-4928-af43-e45f246257f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:35.185832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 903/1811] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:34 2022] DELETE /identity/v3/projects/6ff5a90e4afc4ec8a8f7188a8df857cc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:35.193391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:35.193895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:35.193996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:35.258166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:35.260215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:35.457060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 909/1812] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:35.459164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:35.459776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:35.460205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:35.522239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:35.523530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:35.559544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 904/1813] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:35.563816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:35.579763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885356dd-740c-4a7c-ab1b-f240ca016567 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:35.593433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:35.594236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:35.594618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:35.594971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:35.595752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:35.599123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:35.655937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:35.684651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 910/1814] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:35.685046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:35.707053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca357cbe-351d-449c-bed8-c97d5c47ba1c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:35.721275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:35.721879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:35.722343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:35.722839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:35.724985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:35.770969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:35.903117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 905/1815] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:35 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:35.912006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:35.931354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ffabe-af6a-430f-b4b7-2fe6b1691f62 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:36.147947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:36.149675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.149675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.149675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.150536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:36.182592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:36.300022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 911/1816] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:35 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:36.305229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:36.315635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d575-f092-4fe9-a5f5-7b1aeb485d4a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:36.321404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:36.322067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.322356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.322647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.323683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:36.352581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af66e9-84aa-4a65-a0d7-7386231ff570 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:36.369626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 906/1817] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:36.370578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:36.389323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d325434-67d1-475d-970d-3613119f1bf6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:36.396807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:36.397639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.397945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.398236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] PATH_INFO: `/v3/projects/e49702698a2a4a14b831f6a72cb9907a/users/3c8c6db3e9ee404fa2a6b753556fa822/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.445399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49702698a2a4a14b831f6a72cb9907a, user_id=3c8c6db3e9ee404fa2a6b753556fa822, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:36.487905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeacb00-388d-4579-ac73-2dae77cea490 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:36.601278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 912/1818] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:36 2022] PUT /identity/v3/projects/e49702698a2a4a14b831f6a72cb9907a/users/3c8c6db3e9ee404fa2a6b753556fa822/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:36.603569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3979c-0afd-45a5-9402-efc5b50e06c6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.604946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3979c-0afd-45a5-9402-efc5b50e06c6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.604946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3979c-0afd-45a5-9402-efc5b50e06c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.649505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-30c3979c-0afd-45a5-9402-efc5b50e06c6 None None] MFA Rules not processed for user `3c8c6db3e9ee404fa2a6b753556fa822`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:36.651293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-30c3979c-0afd-45a5-9402-efc5b50e06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:36.798893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 907/1819] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:36.821133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520e91-d434-4416-a12b-208ed887c340 None None] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.821678 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520e91-d434-4416-a12b-208ed887c340 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.822795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520e91-d434-4416-a12b-208ed887c340 None None] PATH_INFO: `/` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.825592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 913/1820] 10.222.0.11 () {54 vars in 961 bytes} [Wed Apr 6 10:18:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:36.833603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:36.834142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:36.834595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:36.866574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] MFA Rules not processed for user `91fdfcc74542409cb3c1b0ac2ea8c052`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:36.867993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:36.960897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520e91-d434-4416-a12b-208ed887c340 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:36.963157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-71520e91-d434-4416-a12b-208ed887c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:37.007922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 908/1821] 10.222.0.11 () {58 vars in 1058 bytes} [Wed Apr 6 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:37.008990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:37.037493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bd2b3-b861-4280-b90d-09225ebb0e90 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:37.046989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:37.047665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:37.048024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:37.048415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:37.068823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:37.134616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793576da-f9b4-4e94-8894-5c25976c3cb0 service glance] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:37.141891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520e91-d434-4416-a12b-208ed887c340 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:37.150206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:37.151024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:37.151474 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:37.151899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] PATH_INFO: `/v3/users/53b58248fd95432d93fd0832776b7570` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:37.154070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b58248fd95432d93fd0832776b7570)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:37.177841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 909/1822] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:37.212940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:37.390969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b58248fd95432d93fd0832776b7570'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:37.422117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b58248fd95432d93fd0832776b7570'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:37.518247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b58248fd95432d93fd0832776b7570'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:37.554522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b58248fd95432d93fd0832776b7570'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:37.555653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b58248fd95432d93fd0832776b7570'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:37.566465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 914/1823] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:36 2022] DELETE /identity/v3/users/53b58248fd95432d93fd0832776b7570 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:37.572131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe23d-3909-4e69-972d-45e27104755d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:37.572624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe23d-3909-4e69-972d-45e27104755d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:37.572794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fe23d-3909-4e69-972d-45e27104755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:37.611821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3a3fe23d-3909-4e69-972d-45e27104755d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:37.613468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3a3fe23d-3909-4e69-972d-45e27104755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:37.721895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 910/1824] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:18:37.763898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:37.766233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:37.867719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720bc1-7951-459a-b202-8f655dfa581a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:37.877821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:37.879081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:37.881268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:37.882229 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:37.893906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:37.959347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394cf2e-4315-425e-8a6b-81e0b262264e service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:37.983064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 915/1825] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:38.760060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:38.760629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:38.760629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:38.763283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 911/1826] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:18:38.781235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:38.781717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:38.781820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:38.833039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] MFA Rules not processed for user `7be23285393b46bfb3a98e839c603cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:38.834411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:38.964236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 916/1827] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:18:38 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:39.403067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:39.407114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:39.431831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523bd3-e424-482a-bffe-b1ea045c892b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:39.439393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:39.440269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:39.440770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:39.454742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:39.480741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:39.532658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:39.546794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:39.548589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:39.565755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 912/1828] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:39 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:18:39.581567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18714eeb-d247-4a77-b278-431d6407e204 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:39.592031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:39.593098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:39.593383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:39.593663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] PATH_INFO: `/v3/projects/a2aef262e7554baf9e522ca5f04e3c65` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:39.594816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2aef262e7554baf9e522ca5f04e3c65)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:39.626455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:39.776783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2aef262e7554baf9e522ca5f04e3c65', 'request_id': 'req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:39.789832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2aef262e7554baf9e522ca5f04e3c65', 'request_id': 'req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:39.796073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2aef262e7554baf9e522ca5f04e3c65', 'request_id': 'req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:39.877777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] The token cache is being invalidate because project a2aef262e7554baf9e522ca5f04e3c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:39.878083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:39.878670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:39.880609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 917/1829] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:39 2022] DELETE /identity/v3/projects/a2aef262e7554baf9e522ca5f04e3c65 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:39.884572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:39.895003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9e863-d73e-4771-95da-6c3668d83524 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:39.960133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:39.960967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:39.961252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:39.961531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] PATH_INFO: `/v3/users/13806f5ff2c7429493e0c43926fd5391` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:39.962627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13806f5ff2c7429493e0c43926fd5391)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:39.989099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:40.171458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13806f5ff2c7429493e0c43926fd5391'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:40.238175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13806f5ff2c7429493e0c43926fd5391'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:40.246626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13806f5ff2c7429493e0c43926fd5391'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:40.258920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13806f5ff2c7429493e0c43926fd5391'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:40.259622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1d9fc678-1bbc-4abb-9f5c-5df0e246816d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13806f5ff2c7429493e0c43926fd5391'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:40.265534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 913/1830] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:18:39 2022] DELETE /identity/v3/users/13806f5ff2c7429493e0c43926fd5391 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:40.903492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:40.906034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:40.926500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcad36-0e8c-41ae-97f5-101f9f830eb3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:40.999236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:41.000052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:41.000334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:41.000612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] PATH_INFO: `/v3/projects/b9aa3401bbf7422f85960c6a07271231` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:41.001692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9aa3401bbf7422f85960c6a07271231)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:41.028887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:41.173072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9aa3401bbf7422f85960c6a07271231', 'request_id': 'req-bec60d80-273f-420c-b0c1-e341867852fa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:41.184821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9aa3401bbf7422f85960c6a07271231', 'request_id': 'req-bec60d80-273f-420c-b0c1-e341867852fa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:41.189828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9aa3401bbf7422f85960c6a07271231', 'request_id': 'req-bec60d80-273f-420c-b0c1-e341867852fa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:41.299129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] The token cache is being invalidate because project b9aa3401bbf7422f85960c6a07271231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:18:41.300602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:41.301866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bec60d80-273f-420c-b0c1-e341867852fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:18:41.303372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 918/1831] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:18:40 2022] DELETE /identity/v3/projects/b9aa3401bbf7422f85960c6a07271231 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:41.309212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:41.309714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:41.309787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:41.337870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:41.340526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:41.437916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 914/1832] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:18:41.448060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:41.448546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:41.449308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:41.482450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:41.483759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:41.496062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 919/1833] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:41.496787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:41.508596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd115-9468-4e69-91dc-791f6c05bfe6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:41.524814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:41.525726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:41.538995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:41.538995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:41.538995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:18:41.538995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:41.561282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:41.581899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 915/1834] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:18:41.586619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:41.598098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e79ad-1404-4592-bb51-ee1a8df28116 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:41.609463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:41.610215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:41.610396 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:41.619208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:41.619208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:41.678219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:41.851273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 920/1835] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:41 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:41.855442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:41.884959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c437d-29ef-4f2f-a75e-fdd2ae93c704 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:42.067373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:42.069292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:42.069292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:42.069908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:42.070899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:42.107261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:42.243395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 916/1836] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:41 2022] POST /identity/v3/users => generated 287 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:42.244654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:42.256930 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978ad90-cc21-435c-9644-f93239394db1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:42.266002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:42.266857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:42.267426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:42.267880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:42.270383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:42.317511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51213181-4f2e-4c33-8002-7b89c4806d90 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:42.330759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 921/1837] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:42.335072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:42.356693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d55e-8c08-4af8-9d4e-b099f962e11c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:42.362882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:42.364829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:42.365022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:42.365237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] PATH_INFO: `/v3/projects/2086581c98a14da9bff9017750c34a11/users/4a8842fc956d44d1a2d2d1413408575f/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:42.388876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2086581c98a14da9bff9017750c34a11, user_id=4a8842fc956d44d1a2d2d1413408575f, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:42.445358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:42.574743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 917/1838] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:42 2022] PUT /identity/v3/projects/2086581c98a14da9bff9017750c34a11/users/4a8842fc956d44d1a2d2d1413408575f/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:42.576083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1e06-63c4-47cf-b35a-186d1ef47eb6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:42.576554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1e06-63c4-47cf-b35a-186d1ef47eb6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:42.576891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1e06-63c4-47cf-b35a-186d1ef47eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:42.625500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2a6d1e06-63c4-47cf-b35a-186d1ef47eb6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:42.625500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2a6d1e06-63c4-47cf-b35a-186d1ef47eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:42.718075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 922/1839] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:42.748916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:42.750949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:42.865017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81da5-c675-49b0-9878-77a2865f4d71 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:42.868576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:42.869697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:42.869697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:42.869899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:42.886377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:42.965192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:42.985144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 918/1840] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:44.680582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:44.681192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:44.681192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:44.732526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] MFA Rules not processed for user `4a8842fc956d44d1a2d2d1413408575f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:44.733882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:44.820833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 923/1841] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:44.824902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:44.834977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae08ec-5b77-49cb-ac5d-f90ece2a184a service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:44.839898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:44.840659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:44.840948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:44.841233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:44.841901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:44.871661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:44.982398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 919/1842] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:18:44 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:18:44.986370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:44.998060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3fa10-f92e-4982-aca7-86e390dc0d72 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.063024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.063632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.063917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.064194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.064830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.090040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.169495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 924/1843] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:18:44 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:18:45.173522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.184626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f74c-ba7f-410f-8aa5-e480657a5350 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.189176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.189765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.190084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.190364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.191087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.216661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.231918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 920/1844] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:18:45.233058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.247204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541b39-f0ac-40b6-94b2-7b0d3f552278 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.251631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.252457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.252900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.253182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] PATH_INFO: `/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.276350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b18df55f854f4798c039e6354a758e, user_id=b2204703af8d460faa8bbd294954f354, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.303362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.381244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 925/1845] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:45 2022] PUT /identity/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:18:45.384869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.395024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73667f7-802f-481d-b791-656e9547e50a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.470535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.471281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.471571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.471853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.472556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.500806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.512532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 921/1846] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:18:45.516485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.528518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155e31-41b3-412c-af84-38a146163cff admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.533216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.534170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.535710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.535710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] PATH_INFO: `/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.537224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b18df55f854f4798c039e6354a758e, user_id=b2204703af8d460faa8bbd294954f354, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.565762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.576985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 926/1847] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:45 2022] PUT /identity/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:45.581154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.590875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db6d56-2a94-4c3b-b402-c288ee705f72 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.659829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.660873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.661234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.661587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.662416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.690050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6491c8-099e-4b47-8bd0-9cc01075114a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.702735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 922/1848] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:18:45.707184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:45.717485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37ca85-7130-4c97-993f-7d810c4ff498 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:45.722049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:45.723017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:45.723566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:45.724025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] PATH_INFO: `/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:45.726287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b18df55f854f4798c039e6354a758e, user_id=b2204703af8d460faa8bbd294954f354, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:45.753440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:45.837045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 927/1849] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:18:45 2022] PUT /identity/v3/projects/70b18df55f854f4798c039e6354a758e/users/b2204703af8d460faa8bbd294954f354/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:18:47.996781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e30b-2558-406b-a90c-758561b9132d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:47.997279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e30b-2558-406b-a90c-758561b9132d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:47.997497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e30b-2558-406b-a90c-758561b9132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:48.040664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9208e30b-2558-406b-a90c-758561b9132d None None] MFA Rules not processed for user `b2204703af8d460faa8bbd294954f354`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:18:48.041952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9208e30b-2558-406b-a90c-758561b9132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:48.154516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 923/1850] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:18:48.223849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:48.226331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:48.326708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c9ac-8d4d-42c7-a427-7835748d0af8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:48.338963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:48.340022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:48.340485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:48.340959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:48.431418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:48.463264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:48.487165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 928/1851] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:48 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:18:50.317400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e30b-2558-406b-a90c-758561b9132d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:18:50.319618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9208e30b-2558-406b-a90c-758561b9132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:18:50.331869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e30b-2558-406b-a90c-758561b9132d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:18:50.347808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:18:50.348824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:18:50.355007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:18:50.355007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:18:50.360035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:18:50.387561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b96e1-c0c9-478a-8b1b-9a999c682d34 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:18:50.411687 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 924/1852] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:04.555557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:04.559302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:04.647539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989743a-9eef-421d-b175-58e5e7cb3e39 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:04.653662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:04.654827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:04.655712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:04.656190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] PATH_INFO: `/v3/users/413f056d52704104b5a09e55b797e7c4` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:04.657807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=413f056d52704104b5a09e55b797e7c4)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:04.685314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:04.934532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413f056d52704104b5a09e55b797e7c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:04.959743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413f056d52704104b5a09e55b797e7c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:05.031778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413f056d52704104b5a09e55b797e7c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:05.049886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413f056d52704104b5a09e55b797e7c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:05.051901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413f056d52704104b5a09e55b797e7c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:05.069661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 929/1853] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:04 2022] DELETE /identity/v3/users/413f056d52704104b5a09e55b797e7c4 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:05.070609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:05.071069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:05.071363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:05.103036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:05.104425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:05.211434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 925/1854] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:05.223974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:05.225992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:05.309972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6502ef-4386-4514-9d20-3864b308ba03 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:05.313824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:05.314245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:05.314536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:05.314831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:05.326940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:05.354533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011ccb-d8b9-4774-b3a5-13d0f3cacf6e service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:05.377958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 930/1855] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:06.005593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.007582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:06.029358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb2a9c-c70e-4233-8225-46dc25c146bc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.034145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.035802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.036363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.036840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] PATH_INFO: `/v3/projects/87a50096fc3440fda295425664e4f31e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.038748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a50096fc3440fda295425664e4f31e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:06.071727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:06.210176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a50096fc3440fda295425664e4f31e', 'request_id': 'req-6ff02cd0-b619-4187-8816-019df47fb441'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:06.288911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a50096fc3440fda295425664e4f31e', 'request_id': 'req-6ff02cd0-b619-4187-8816-019df47fb441'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:06.300755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a50096fc3440fda295425664e4f31e', 'request_id': 'req-6ff02cd0-b619-4187-8816-019df47fb441'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:06.310596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] The token cache is being invalidate because project 87a50096fc3440fda295425664e4f31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:06.310885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:06.311494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ff02cd0-b619-4187-8816-019df47fb441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:06.313111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 926/1856] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:06 2022] DELETE /identity/v3/projects/87a50096fc3440fda295425664e4f31e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:06.318724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.319198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.319287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.344706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:06.345756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:06.413714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 931/1857] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:06.421382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.421703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.422031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.446038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:06.447213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:06.454612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 927/1858] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:06.459315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.468701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32158d-214f-4093-9be6-955d4b097e2d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.473418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.474263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.474494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.474775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.475493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:06.475798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:06.501881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:06.516311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 932/1859] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:06.521614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.531299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661f167-ebfa-451c-8a5f-0a4a1400f49d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.536066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.536650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.536939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.537222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.537852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:06.564400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:06.667184 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 928/1860] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:06 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:06.671328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.682268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf9e2c-c043-40b9-b6f9-6fd5368feb9f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.746792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.747398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.747682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.747958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.748597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:06.775187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:06.869408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 933/1861] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:06 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:06.875468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.885136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74c6a2-1aa4-498f-b2b7-f18eb5224143 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.889275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.889861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.890257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.890545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.891244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:06.918557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91283e49-b871-4486-9f5e-efd2aca2e919 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:06.932771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 929/1862] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:06.934253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:06.945310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec585-45b9-452f-aa2f-6622915fe24d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:06.950665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:06.951654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:06.952035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:06.952381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] PATH_INFO: `/v3/projects/118b4c2c00a9436bbe1753faf3fe61f2/users/05137b42cd85411685dd214194e8897c/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:06.977318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118b4c2c00a9436bbe1753faf3fe61f2, user_id=05137b42cd85411685dd214194e8897c, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:07.007438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:07.123389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 934/1863] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:06 2022] PUT /identity/v3/projects/118b4c2c00a9436bbe1753faf3fe61f2/users/05137b42cd85411685dd214194e8897c/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:07.134896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:07.135359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:07.135472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:07.173332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] MFA Rules not processed for user `05137b42cd85411685dd214194e8897c`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:07.174464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:07.252683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 930/1864] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:07.302557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:07.304272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:07.367943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ddaa-4859-46f6-b5bb-ed5010823906 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:07.371401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:07.371985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:07.372275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:07.372556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:07.380853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:07.406409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:07.415907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 935/1865] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:07 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:17.041382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:17.043484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:17.114901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e13c-a026-4d89-8d2f-3ff4d80f84b0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:17.119152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:17.120130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:17.120450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:17.120735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] PATH_INFO: `/v3/users/edf469d18334489ca7de5775bead3b81` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:17.121829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf469d18334489ca7de5775bead3b81)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:17.148584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:17.304731 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf469d18334489ca7de5775bead3b81'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:17.381273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf469d18334489ca7de5775bead3b81'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:17.392322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf469d18334489ca7de5775bead3b81'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:17.407377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf469d18334489ca7de5775bead3b81'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:17.408346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf469d18334489ca7de5775bead3b81'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:17.416144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 931/1866] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:17 2022] DELETE /identity/v3/users/edf469d18334489ca7de5775bead3b81 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:17.833254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:17.846661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec2ab-4d0a-4b40-9e0c-ba73b2b12411 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:17.966307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:17.967315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:17.967752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:17.968198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] PATH_INFO: `/v3/projects/1ffd94a428684058ae80ac859a4f690e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:17.969428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffd94a428684058ae80ac859a4f690e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:17.997555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:18.004299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.006661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.023015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e420c-f426-48e4-a7ae-adb4eac2c9d3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.034398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:18.035606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.037768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.038247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] PATH_INFO: `/v3/users/3c8c6db3e9ee404fa2a6b753556fa822` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.039791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8c6db3e9ee404fa2a6b753556fa822)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:18.069877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:18.117331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffd94a428684058ae80ac859a4f690e', 'request_id': 'req-78bcd3af-591f-490e-86d0-cf4071f09c18'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.131699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffd94a428684058ae80ac859a4f690e', 'request_id': 'req-78bcd3af-591f-490e-86d0-cf4071f09c18'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.139593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffd94a428684058ae80ac859a4f690e', 'request_id': 'req-78bcd3af-591f-490e-86d0-cf4071f09c18'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.197880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] The token cache is being invalidate because project 1ffd94a428684058ae80ac859a4f690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:18.198207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.198807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.200377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 936/1867] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:17 2022] DELETE /identity/v3/projects/1ffd94a428684058ae80ac859a4f690e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:18.201174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.202663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.225993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8c6db3e9ee404fa2a6b753556fa822'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.277456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd3af-591f-490e-86d0-cf4071f09c18 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.281824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:18.282787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.283078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.283357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] PATH_INFO: `/v3/users/05137b42cd85411685dd214194e8897c` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.284457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05137b42cd85411685dd214194e8897c)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:18.294299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8c6db3e9ee404fa2a6b753556fa822'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.304052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8c6db3e9ee404fa2a6b753556fa822'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.312935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:18.316210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8c6db3e9ee404fa2a6b753556fa822'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.316924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-cc32aed3-a142-4819-b40d-22870f2a64cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8c6db3e9ee404fa2a6b753556fa822'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.323405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 932/1868] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:18 2022] DELETE /identity/v3/users/3c8c6db3e9ee404fa2a6b753556fa822 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:18.324394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.324690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.324975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.349660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:18.350874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.417359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 933/1869] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:18.418158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.419341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.430386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3255dfe-38b5-4d07-9b58-58d63f81e468 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.434655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:18.435436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.435728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.436007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] PATH_INFO: `/v3/users/4a8842fc956d44d1a2d2d1413408575f` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.437091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8842fc956d44d1a2d2d1413408575f)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:18.456074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05137b42cd85411685dd214194e8897c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.463007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:18.464270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05137b42cd85411685dd214194e8897c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.574112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05137b42cd85411685dd214194e8897c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.586765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05137b42cd85411685dd214194e8897c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.587383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1a75ad14-c934-4054-bad7-bd52f9ead9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05137b42cd85411685dd214194e8897c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.593258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 937/1870] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:18 2022] DELETE /identity/v3/users/05137b42cd85411685dd214194e8897c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:18.594476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849984-792d-463f-9274-5b5021e65981 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.594770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849984-792d-463f-9274-5b5021e65981 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.595055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849984-792d-463f-9274-5b5021e65981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.617227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-25849984-792d-463f-9274-5b5021e65981 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:18.618395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-25849984-792d-463f-9274-5b5021e65981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.682655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 938/1871] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:18.683818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f9d5-21db-436f-adbb-fe24408dbc96 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.684110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f9d5-21db-436f-adbb-fe24408dbc96 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.684390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30f9d5-21db-436f-adbb-fe24408dbc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.709544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0c30f9d5-21db-436f-adbb-fe24408dbc96 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:18.711006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0c30f9d5-21db-436f-adbb-fe24408dbc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.719032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 939/1872] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:18.720466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.724352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.724352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.744978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:18.749593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.752881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 940/1873] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:18.753535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8842fc956d44d1a2d2d1413408575f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.753709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.755599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.814361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8842fc956d44d1a2d2d1413408575f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.819612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f2bb-5a35-4416-ae3e-9f7c0793faba None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.823160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:18.823297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8842fc956d44d1a2d2d1413408575f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.823741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.824025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.824501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.833665 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:18.835483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8842fc956d44d1a2d2d1413408575f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.838044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8842fc956d44d1a2d2d1413408575f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:18.841954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 934/1874] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:18 2022] DELETE /identity/v3/users/4a8842fc956d44d1a2d2d1413408575f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:18.845212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.845212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:18.860451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:18.871597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 941/1875] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:18.872612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:18.881691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3438-0846-4135-9495-889a61d337e2 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.962006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f408-5b5b-4dcc-a79c-ce78919c8527 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:18.979784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:18.980919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:18.982848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:18.984896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:18.986723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:18.987140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.048847 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.049709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.050368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.050846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.057643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:19.089917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.094525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.123863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 935/1876] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:19.128042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:19.139558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637701d-ca30-4791-b606-81d3100ef192 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:19.145914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.152422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.152422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.152422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.152422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.153214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.162987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 942/1877] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:19.175270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.234781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:19.236727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:19.250283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969ac2-8afd-4e9e-a402-fe762c75753b service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:19.257454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.258378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.258670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.258951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] PATH_INFO: `/v3/projects/2086581c98a14da9bff9017750c34a11` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.260060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2086581c98a14da9bff9017750c34a11)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.289869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.363118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 936/1878] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:19 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:19.365572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:19.469141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2086581c98a14da9bff9017750c34a11', 'request_id': 'req-28e46d87-8504-4796-a513-f88c2fb9598b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.480909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b085d-4a35-4467-a6ab-73ae814a60f4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:19.486613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2086581c98a14da9bff9017750c34a11', 'request_id': 'req-28e46d87-8504-4796-a513-f88c2fb9598b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.492233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2086581c98a14da9bff9017750c34a11', 'request_id': 'req-28e46d87-8504-4796-a513-f88c2fb9598b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.553520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.554177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.554493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.554777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.555418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.587851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] The token cache is being invalidate because project 2086581c98a14da9bff9017750c34a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:19.588415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.589170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.589282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.597232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 943/1879] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:19 2022] DELETE /identity/v3/projects/2086581c98a14da9bff9017750c34a11 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:19.601758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:19.605141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:19.623653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46d87-8504-4796-a513-f88c2fb9598b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:19.632962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.632962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.632962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.632962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] PATH_INFO: `/v3/users/b2204703af8d460faa8bbd294954f354` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.633599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2204703af8d460faa8bbd294954f354)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.656605 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 937/1880] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:19 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:19.657298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:19.661359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:19.665107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.677667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f59a5-d02a-4c82-a36c-9a3a4a650e6a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:19.684905 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:19.685752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:19.686077 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:19.686768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] PATH_INFO: `/v3/projects/e49702698a2a4a14b831f6a72cb9907a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:19.687649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49702698a2a4a14b831f6a72cb9907a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:19.714483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:19.904003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2204703af8d460faa8bbd294954f354'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.905618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49702698a2a4a14b831f6a72cb9907a', 'request_id': 'req-ada59f19-8837-4107-a3e1-e0db049b57c0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.913333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2204703af8d460faa8bbd294954f354'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:19.997161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49702698a2a4a14b831f6a72cb9907a', 'request_id': 'req-ada59f19-8837-4107-a3e1-e0db049b57c0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.009823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49702698a2a4a14b831f6a72cb9907a', 'request_id': 'req-ada59f19-8837-4107-a3e1-e0db049b57c0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.020244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] The token cache is being invalidate because project e49702698a2a4a14b831f6a72cb9907a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:20.020530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.021231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.022704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 938/1881] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:19 2022] DELETE /identity/v3/projects/e49702698a2a4a14b831f6a72cb9907a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:20.023460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.024691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.088848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2204703af8d460faa8bbd294954f354'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.105586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2204703af8d460faa8bbd294954f354'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.105586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2204703af8d460faa8bbd294954f354'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.106969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada59f19-8837-4107-a3e1-e0db049b57c0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.111452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.115360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.115493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 944/1882] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:19 2022] DELETE /identity/v3/users/b2204703af8d460faa8bbd294954f354 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:20.115590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.115590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.115742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.115812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.115962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.140797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f4647-50fa-4c08-ab7a-36f9d6f80a87 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.152590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 939/1883] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:20.153887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.154212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.154499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.181156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:20.181156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.203379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59272627-1303-4bab-844f-4b770a6c02dd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.208605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.209784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.213103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.213103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] PATH_INFO: `/v3/projects/118b4c2c00a9436bbe1753faf3fe61f2` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.213103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] RBAC: Authorizing `identity:delete_project(project_id=118b4c2c00a9436bbe1753faf3fe61f2)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.238662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.256445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 940/1884] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:20.257594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.259172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.270768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a52b-7035-40b6-b11b-3bd0637dd4f0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.276213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.277555 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.278082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.278432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] PATH_INFO: `/v3/projects/6fa59c85afb44ed2b62b06378c5fba49/users/afef28a167e84f26a8bd5ef64a124ce9/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.298628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa59c85afb44ed2b62b06378c5fba49, user_id=afef28a167e84f26a8bd5ef64a124ce9, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.326035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdcd88-14e5-4f13-81b3-65e50be58e31 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.481742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 941/1885] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:20 2022] PUT /identity/v3/projects/6fa59c85afb44ed2b62b06378c5fba49/users/afef28a167e84f26a8bd5ef64a124ce9/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:20.486888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ae359-7642-4f82-a7ba-9a0a7699bf4b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.487178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ae359-7642-4f82-a7ba-9a0a7699bf4b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.492312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ae359-7642-4f82-a7ba-9a0a7699bf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.492434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118b4c2c00a9436bbe1753faf3fe61f2', 'request_id': 'req-5557c6f6-1282-48be-9d46-5ce176ae528d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.503763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118b4c2c00a9436bbe1753faf3fe61f2', 'request_id': 'req-5557c6f6-1282-48be-9d46-5ce176ae528d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.510952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118b4c2c00a9436bbe1753faf3fe61f2', 'request_id': 'req-5557c6f6-1282-48be-9d46-5ce176ae528d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.528312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-170ae359-7642-4f82-a7ba-9a0a7699bf4b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:20.529479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-170ae359-7642-4f82-a7ba-9a0a7699bf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.602686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 942/1886] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:20.602686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.602686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.602686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.606284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] The token cache is being invalidate because project 118b4c2c00a9436bbe1753faf3fe61f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:20.606641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.607367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.610252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 945/1887] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:20 2022] DELETE /identity/v3/projects/118b4c2c00a9436bbe1753faf3fe61f2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:20.610252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.611454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.625984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:20.627121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.628124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c6f6-1282-48be-9d46-5ce176ae528d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.632833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.633635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.633963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.634238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] PATH_INFO: `/v3/projects/70b18df55f854f4798c039e6354a758e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.634571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 943/1888] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:20.635592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.636817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.638299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b18df55f854f4798c039e6354a758e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.649333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb859-c566-4ec1-9163-8daac331d99c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.653665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.654295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.654577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.654858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.655577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:20.655873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.665990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.682734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676f5e0-240e-4855-9c4c-06a7fd80936d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.696894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 944/1889] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:20.698300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.698640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.699052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.721975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:20.723096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.731210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 945/1890] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:20.732092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.736410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.768837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b18df55f854f4798c039e6354a758e', 'request_id': 'req-91ac4ff1-ce76-491e-bdae-0d3a47754991'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.780303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b18df55f854f4798c039e6354a758e', 'request_id': 'req-91ac4ff1-ce76-491e-bdae-0d3a47754991'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.785406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b18df55f854f4798c039e6354a758e', 'request_id': 'req-91ac4ff1-ce76-491e-bdae-0d3a47754991'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.796657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab741-ce48-451c-b2f7-f46e3349ed88 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.851939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.852527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.852810 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.853088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.858414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] The token cache is being invalidate because project 70b18df55f854f4798c039e6354a758e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:20.858699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.859308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:20.860840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 946/1891] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:20 2022] DELETE /identity/v3/projects/70b18df55f854f4798c039e6354a758e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:20.861577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:20.863206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:20.927205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.951319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4ff1-ce76-491e-bdae-0d3a47754991 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:20.955734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:20.956336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.956626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.956909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.958091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:20.958336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fbc56-cdef-4512-b1b6-b279c35fbe3f service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.968373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 946/1892] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:20.969669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa8c9-b297-466c-a7b6-b2f94a64cc57 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:20.970099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa8c9-b297-466c-a7b6-b2f94a64cc57 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:20.970477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa8c9-b297-466c-a7b6-b2f94a64cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:20.984302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:20.996898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-877fa8c9-b297-466c-a7b6-b2f94a64cc57 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:20.998209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-877fa8c9-b297-466c-a7b6-b2f94a64cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:21.006680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 947/1893] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:21.008050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.011293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.011293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.076341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 947/1894] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:20 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.076341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.112719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:21.114890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:21.152121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e12844-2e75-4b31-a706-a960de988b95 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.157093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.157712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.158079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.158371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.159114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:21.159361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.193409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 948/1895] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:21.193618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd560fe-ff57-4391-b322-749ea5eb7230 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.193717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.199993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa23e9-d879-4a44-b2bd-3729a97a5864 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.201609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 948/1896] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:21.204234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.204624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.204918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.205726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.208196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.208196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.208196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.208416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.235997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.240850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:21.242699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:21.249487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 949/1897] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:21.250290 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.260487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9313e13-468c-43ec-a4d2-7a1030dee86b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.264935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.265520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.265810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.266124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.266763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.297268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.337779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 949/1898] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.337779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.349149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10e02-d32b-4e43-9111-78c9ff2c103a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.354677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.355365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.355970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.356325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.357151 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:21.357651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.386858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.401539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 950/1899] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:21.402420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.411945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd968-f581-403b-8cf4-523b21e009f3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.416061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.416646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.416930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.417213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.417891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.428942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 950/1900] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.430172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.444754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.455565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 951/1901] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:21.456279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.466393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a2c9-9261-4351-ae2c-e4309f1a95eb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.510853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1da2-1a1e-4f5b-a793-a7f2583c931c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.515397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.516075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.516545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.516899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.517872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.534333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.535302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.535302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.536230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.536636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.544605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.563634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.665658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 951/1902] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.665658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.712783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 952/1903] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.713960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.730403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afece0e-6bb9-4e0e-a1b7-4c6f07b6cc79 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.780206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d54b6f-ba63-4c08-b4bc-7acc5e063c52 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:21.787479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.788335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.788657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.789023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] PATH_INFO: `/v3/projects/288410f049e84b89bb641d5a13dbe0de/users/54447a4412724bc19063c0755a120c7f/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.816680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] RBAC: Authorizing `identity:create_grant(project_id=288410f049e84b89bb641d5a13dbe0de, user_id=54447a4412724bc19063c0755a120c7f, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.827344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:21.827965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.828250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.828581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:21.829260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:21.846932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.858958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115452c8-0ef3-4d57-85d8-66cb89d8292e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:21.922928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 952/1904] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:21 2022] PUT /identity/v3/projects/288410f049e84b89bb641d5a13dbe0de/users/54447a4412724bc19063c0755a120c7f/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:21.923927 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:21.964178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 953/1905] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:21.965578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:21.966219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:21.966630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.020698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00a3f-b04f-4df7-9950-7e5354cc05db admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.050673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.051586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.052034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.053888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.053888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.054112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] MFA Rules not processed for user `54447a4412724bc19063c0755a120c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:22.056500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:22.104081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.128923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 953/1906] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:22.135839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.146530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 954/1907] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:22.147492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.155360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373c6f-71e9-4deb-83e2-bce1992caee3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.159397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e659d-b464-416f-8510-511e4449a7b8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.169069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.169222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.169341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.169445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.169530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.169611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.169690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] PATH_INFO: `/v3/projects/89ed7903d80246599aa18eff8de20d8e/users/1e48bd3c72e54acf960df8ef4513f81f/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.169771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.169771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.189490 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ed7903d80246599aa18eff8de20d8e, user_id=1e48bd3c72e54acf960df8ef4513f81f, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.196843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.210726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 954/1908] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:22.210726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.218522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.219093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7499a-058e-44d9-ac5e-4faceff471ea admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.224775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.225385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.225655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.231595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.231595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.253321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7c16-7979-44a1-8481-9ca3b2207843 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.312127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 955/1909] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:22 2022] PUT /identity/v3/projects/89ed7903d80246599aa18eff8de20d8e/users/1e48bd3c72e54acf960df8ef4513f81f/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:22.312127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.359741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 955/1910] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:22 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:22.361066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.361367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.361653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.384336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde1cc-1129-446d-b179-fb7a42e4fc86 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.387629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:22.388864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:22.452997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.456669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.456669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.456669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] PATH_INFO: `/v3/projects/3857690a945d4b1ea5a6a439f00b8218/users/05739bc0782347e0acbf5e528429ce93/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.456954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 956/1911] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:22.456954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.474227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97237d2-6587-4499-ac83-85316587d4ed None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.479242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.479852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.480165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.480443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.481077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.486037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3857690a945d4b1ea5a6a439f00b8218, user_id=05739bc0782347e0acbf5e528429ce93, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.508201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.517734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.614740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 957/1912] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:22 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:22.614740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.619468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:22.639464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 956/1913] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:22 2022] PUT /identity/v3/projects/3857690a945d4b1ea5a6a439f00b8218/users/05739bc0782347e0acbf5e528429ce93/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:22.642928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.699876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b1c0-28b3-42dd-bd4a-23653db507b0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.732873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f2b9-9431-4e8c-b606-8fea11d75838 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.737527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.738299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.738598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.739485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.740866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.764493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.765074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.765363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.765642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.777970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.782054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e8e2-6d75-4964-81b4-6d5ffc24c746 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.798347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 957/1914] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:22.799971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.800529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.800973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.809592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.822308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 958/1915] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:22.822948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.834393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b888-7424-41d0-9d7f-49d479a93aa1 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:22.839418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:22.840026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.840282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.840559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] PATH_INFO: `/v3/projects/c12e9889d4524998949ba156d5e999d3/users/de8d5f6490bc44d6b8f625986830ff2b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:22.849251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] MFA Rules not processed for user `05739bc0782347e0acbf5e528429ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:22.851382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:22.864979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12e9889d4524998949ba156d5e999d3, user_id=de8d5f6490bc44d6b8f625986830ff2b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:22.894794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051138a9-9a27-4a9a-a8a2-ac0a66f661aa admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:22.940774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 958/1916] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:22.952279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:22.953637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:22.975364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 959/1917] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:22 2022] PUT /identity/v3/projects/c12e9889d4524998949ba156d5e999d3/users/de8d5f6490bc44d6b8f625986830ff2b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:22.986764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba031-3705-42d0-a963-668669f37853 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:22.988212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba031-3705-42d0-a963-668669f37853 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:22.989263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ba031-3705-42d0-a963-668669f37853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.197761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-790ba031-3705-42d0-a963-668669f37853 None None] MFA Rules not processed for user `de8d5f6490bc44d6b8f625986830ff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:23.197761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-790ba031-3705-42d0-a963-668669f37853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:23.199324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c05bdc-177d-4f93-941f-1f79b7feb49f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:23.199324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:23.199324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:23.199324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:23.200009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.200086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 960/1918] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:23.200086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ba031-3705-42d0-a963-668669f37853 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:23.201551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:23.229347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:23.244351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 959/1919] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:22 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:19:23.278607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ba031-3705-42d0-a963-668669f37853 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:23.295902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:23.295902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:23.295902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:23.295902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.296498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:23.314250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:23.537913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 961/1920] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:23 2022] POST /identity/v3/projects => generated 375 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:23.550364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:23.573332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73766-f29e-434d-a2e8-d18379b5aec9 service glance] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:23.720195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:23.720195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:23.720195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:23.720195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.720692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:23.744980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:23.849909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 960/1921] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:23 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:23.855734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:23.865467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769188-f826-4c1a-b174-64b629fb55bd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:23.869844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:23.870469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:23.870972 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:23.871263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.872245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:23.900765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:23.915456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 962/1922] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:23.918165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:23.929590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a028c21-d74f-4ad8-8e5e-919809110667 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:23.957149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:23.958476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:23.958476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:23.958737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] PATH_INFO: `/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:23.995809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ca6a72078440591d8dd3d82346668, user_id=d77af76993d54389b340a40a220d333b, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:24.029306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:24.092963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 961/1923] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:23 2022] PUT /identity/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:24.097126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:24.109200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8ec11-9192-49ce-b78b-921339e6328f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:24.246748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:24.247816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:24.247816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:24.247994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:24.248739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:24.286644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:24.319131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:24.319798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 963/1924] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:24.329954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8aa82-bba6-4541-aba5-f3bf75406bee admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:24.351931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:24.353111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:24.353475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:24.353831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] PATH_INFO: `/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:24.356355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ca6a72078440591d8dd3d82346668, user_id=d77af76993d54389b340a40a220d333b, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:24.417440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:24.432656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 962/1925] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:24 2022] PUT /identity/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:24.436462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:24.451370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a680c-1bbf-4f8a-8c61-17b828b1aca6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:24.537782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:24.538829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:24.539364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:24.539846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:24.540762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:24.568154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136865ff-3422-4aa9-bbe5-85ddc94e6995 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:24.581260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 964/1926] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:24.584942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:24.610442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cced26-f1ca-40ab-be94-129985c36c2d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:24.616251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:24.616940 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:24.617333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:24.617718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] PATH_INFO: `/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:24.619947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ca6a72078440591d8dd3d82346668, user_id=d77af76993d54389b340a40a220d333b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:24.657832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:24.753988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 963/1927] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:24 2022] PUT /identity/v3/projects/9c3ca6a72078440591d8dd3d82346668/users/d77af76993d54389b340a40a220d333b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:24.764342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f321f-d591-4040-8120-f02c6e5e07c6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:24.765146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f321f-d591-4040-8120-f02c6e5e07c6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:24.765146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f321f-d591-4040-8120-f02c6e5e07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:24.808773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-549f321f-d591-4040-8120-f02c6e5e07c6 None None] MFA Rules not processed for user `d77af76993d54389b340a40a220d333b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:24.810523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-549f321f-d591-4040-8120-f02c6e5e07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:24.948487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 965/1928] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:24 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:24.953868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:24.955507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:25.070590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f14cd-f033-4586-974c-bf6f6619ca40 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:25.075377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:25.075985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:25.076281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:25.076569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:25.178265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:25.210053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:25.236582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 964/1929] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:24 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:25.370685 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2231-86ab-4a4b-8696-d328b8cc1e97 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:25.371691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2231-86ab-4a4b-8696-d328b8cc1e97 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:25.372160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2231-86ab-4a4b-8696-d328b8cc1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:25.419193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-129e2231-86ab-4a4b-8696-d328b8cc1e97 None None] MFA Rules not processed for user `1e48bd3c72e54acf960df8ef4513f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:25.421105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-129e2231-86ab-4a4b-8696-d328b8cc1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:25.524045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 966/1930] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:25 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:25.557646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:25.563464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:25.571506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de2c35-40be-408f-94db-44cf74101347 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:25.575193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:25.575974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:25.576426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:25.576881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:25.591473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:25.620774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:25.632839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 965/1931] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:25 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:19:27.775272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228a70-2b52-415d-8e7a-29943bb370b2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:27.776079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228a70-2b52-415d-8e7a-29943bb370b2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:27.776079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228a70-2b52-415d-8e7a-29943bb370b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:27.813572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-19228a70-2b52-415d-8e7a-29943bb370b2 None None] MFA Rules not processed for user `1e48bd3c72e54acf960df8ef4513f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:27.814899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-19228a70-2b52-415d-8e7a-29943bb370b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:27.850061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 967/1932] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:27 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:28.678180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:28.702507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466b94-8835-46c3-9fcc-98c1df7ee859 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:28.709213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:28.709822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:28.710140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:28.710427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:28.829192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:28.874482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:28.887471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 966/1933] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:28 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:19:29.655625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:29.656123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:29.656208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:29.693832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] MFA Rules not processed for user `afef28a167e84f26a8bd5ef64a124ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:29.695030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:29.785170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 968/1934] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:29 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:29.798229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:29.799635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:29.898524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40e7-851a-4d38-aedd-0fe73c8f328f service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:29.903418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:29.904029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:29.904317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:29.904598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:29.913385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:29.939256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6637dc-82b7-465b-9779-6d9521257941 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:29.948967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 967/1935] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:29 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:30.877848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:30.895497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598daf1a-859c-4bb2-acb4-151193d81db2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:30.899002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:30.899670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:30.900028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:30.900417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:30.914717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:30.947123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:30.970660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 969/1936] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:30 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:34.010719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d678-d478-4a2a-862f-0c9aa429d364 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:34.010719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d678-d478-4a2a-862f-0c9aa429d364 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:34.010719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d678-d478-4a2a-862f-0c9aa429d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:34.038086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-51e3d678-d478-4a2a-862f-0c9aa429d364 None None] MFA Rules not processed for user `afef28a167e84f26a8bd5ef64a124ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:34.039298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-51e3d678-d478-4a2a-862f-0c9aa429d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:34.054186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 968/1937] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:34.351824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:34.353827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:34.627326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2204-fd25-422c-bdc6-46ff82585647 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:34.639340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:34.640186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:34.640484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:34.640768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] PATH_INFO: `/v3/users/ad5b92d746924aab9a3d9b9d0b27fdc4` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:34.643839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5b92d746924aab9a3d9b9d0b27fdc4)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:34.696859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:35.180653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5b92d746924aab9a3d9b9d0b27fdc4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:35.197090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5b92d746924aab9a3d9b9d0b27fdc4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:35.310836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5b92d746924aab9a3d9b9d0b27fdc4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:35.345265 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5b92d746924aab9a3d9b9d0b27fdc4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:35.348299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5b92d746924aab9a3d9b9d0b27fdc4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:35.362002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 970/1938] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:34 2022] DELETE /identity/v3/users/ad5b92d746924aab9a3d9b9d0b27fdc4 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:35.363932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:35.363932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:35.363932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:35.423663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:35.435504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:35.559216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 969/1939] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:35.604430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:35.605862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:35.751858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863293c-5760-4f8c-afcc-84ee544d4ac0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:35.768175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:35.768806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:35.769098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:35.778113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:35.795413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:35.847141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:35.863147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 971/1940] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:36.684957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:36.686379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:36.699860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb70a1-4aec-4a4c-b77c-21080c434b6a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:36.704137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:36.704930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:36.705224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:36.705510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] PATH_INFO: `/v3/projects/97c1d04f6a3c4ab1a8abdfc92fc9f73a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:36.706612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c1d04f6a3c4ab1a8abdfc92fc9f73a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:36.732558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:36.857578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c1d04f6a3c4ab1a8abdfc92fc9f73a', 'request_id': 'req-42718235-9d42-40a5-812f-0e5a57a292ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:36.934246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c1d04f6a3c4ab1a8abdfc92fc9f73a', 'request_id': 'req-42718235-9d42-40a5-812f-0e5a57a292ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:36.947413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c1d04f6a3c4ab1a8abdfc92fc9f73a', 'request_id': 'req-42718235-9d42-40a5-812f-0e5a57a292ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:36.987523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] The token cache is being invalidate because project 97c1d04f6a3c4ab1a8abdfc92fc9f73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:36.988045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:36.992215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.001684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:37.013412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f32e-c6c0-4598-b419-ad6ae0833e66 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:37.013656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 970/1941] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:36 2022] DELETE /identity/v3/projects/97c1d04f6a3c4ab1a8abdfc92fc9f73a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:37.152136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:37.155501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:37.157500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:37.158923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] PATH_INFO: `/v3/users/83b1f7ce953f41b3842afb6c2f1f2d82` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:37.161522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b1f7ce953f41b3842afb6c2f1f2d82)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:37.203304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:37.327707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:37.330022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:37.352122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718235-9d42-40a5-812f-0e5a57a292ca admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:37.356788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:37.357588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:37.357873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:37.358185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] PATH_INFO: `/v3/users/54447a4412724bc19063c0755a120c7f` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:37.360360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54447a4412724bc19063c0755a120c7f)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:37.393710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:37.437488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b1f7ce953f41b3842afb6c2f1f2d82'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.446701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b1f7ce953f41b3842afb6c2f1f2d82'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.548157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b1f7ce953f41b3842afb6c2f1f2d82'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.569354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b1f7ce953f41b3842afb6c2f1f2d82'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.570394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-57f0b5db-19b3-4eba-8280-ebd9b5cb5328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b1f7ce953f41b3842afb6c2f1f2d82'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.577837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 972/1942] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:37 2022] DELETE /identity/v3/users/83b1f7ce953f41b3842afb6c2f1f2d82 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:37.708733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54447a4412724bc19063c0755a120c7f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.814604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54447a4412724bc19063c0755a120c7f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.830976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54447a4412724bc19063c0755a120c7f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.879918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54447a4412724bc19063c0755a120c7f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.881364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54447a4412724bc19063c0755a120c7f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:37.901615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 971/1943] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:37 2022] DELETE /identity/v3/users/54447a4412724bc19063c0755a120c7f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:37.906311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12e18-925e-442c-8489-db628509e49e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:37.906612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12e18-925e-442c-8489-db628509e49e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:37.906899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12e18-925e-442c-8489-db628509e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:37.931776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e8f12e18-925e-442c-8489-db628509e49e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:37.933051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e8f12e18-925e-442c-8489-db628509e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:38.004565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 973/1944] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:38.014957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:38.017411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:38.090949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9a45-f828-49b7-8e2c-95edc09d9a51 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:38.094446 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:38.095040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:38.095331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:38.096046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:38.108470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:38.134265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:38.149039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 972/1945] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:38.682435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f12e18-925e-442c-8489-db628509e49e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:38.682435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e8f12e18-925e-442c-8489-db628509e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:38.690209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:38.693575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:38.710745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a7f1e-6c73-45b7-b152-9fd2f984815f service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:38.712039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f12e18-925e-442c-8489-db628509e49e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:38.716549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:38.717362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:38.717652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:38.718089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] PATH_INFO: `/v3/projects/b82cb36629b84ca1958225fe3c20fd63` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:38.718262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:38.719461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:38.719840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:38.720389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] PATH_INFO: `/v3/projects/288410f049e84b89bb641d5a13dbe0de` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:38.720668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82cb36629b84ca1958225fe3c20fd63)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:38.722033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=288410f049e84b89bb641d5a13dbe0de)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:38.752197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:38.759020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:38.896063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288410f049e84b89bb641d5a13dbe0de', 'request_id': 'req-f7a4f130-71fd-4961-ac46-6168e3922dfb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:38.946109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82cb36629b84ca1958225fe3c20fd63', 'request_id': 'req-39e0d79e-a302-4985-a8e9-9879bed46129'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:38.962819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288410f049e84b89bb641d5a13dbe0de', 'request_id': 'req-f7a4f130-71fd-4961-ac46-6168e3922dfb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:38.964596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82cb36629b84ca1958225fe3c20fd63', 'request_id': 'req-39e0d79e-a302-4985-a8e9-9879bed46129'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:38.985702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82cb36629b84ca1958225fe3c20fd63', 'request_id': 'req-39e0d79e-a302-4985-a8e9-9879bed46129'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:38.989238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288410f049e84b89bb641d5a13dbe0de', 'request_id': 'req-f7a4f130-71fd-4961-ac46-6168e3922dfb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.028601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] The token cache is being invalidate because project 288410f049e84b89bb641d5a13dbe0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:39.031850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.031850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.037855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 973/1946] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:38 2022] DELETE /identity/v3/projects/288410f049e84b89bb641d5a13dbe0de => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:39.041878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:39.047877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:39.086234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] The token cache is being invalidate because project b82cb36629b84ca1958225fe3c20fd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:39.086234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.086234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-39e0d79e-a302-4985-a8e9-9879bed46129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.087059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 974/1947] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:38 2022] DELETE /identity/v3/projects/b82cb36629b84ca1958225fe3c20fd63 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:39.091830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2eac-8af7-418d-b2cf-51ac31540235 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.092139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2eac-8af7-418d-b2cf-51ac31540235 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.092441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2eac-8af7-418d-b2cf-51ac31540235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.243248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-060b2eac-8af7-418d-b2cf-51ac31540235 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:39.245764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-060b2eac-8af7-418d-b2cf-51ac31540235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:39.280087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f130-71fd-4961-ac46-6168e3922dfb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:39.409963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 975/1948] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:39.420260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.424248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.424248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.437722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:39.438626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.438945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.439235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] PATH_INFO: `/v3/users/de8d5f6490bc44d6b8f625986830ff2b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.440630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8d5f6490bc44d6b8f625986830ff2b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:39.454950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:39.456461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:39.472059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 976/1949] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:39.476566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:39.479858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:39.494112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53ff6-24b5-4231-bf78-eee7a1fb8d5f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:39.501487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:39.502355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.502819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.503199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.504986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:39.504986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:39.532824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:39.549600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 977/1950] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:39.561858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:39.576922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33e02e-5deb-4be4-a92c-20ff277fa1f6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:39.583376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:39.585811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.585811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.585811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.586099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:39.632788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:39.823662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 978/1951] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:39 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:39.827578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:39.905472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8d5f6490bc44d6b8f625986830ff2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:39.909722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec628-94b8-419a-bafa-0bdb7f638ccf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:39.918394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:39.919022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:39.919312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:39.919596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:39.920437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:39.946666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.019748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8d5f6490bc44d6b8f625986830ff2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.028231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8d5f6490bc44d6b8f625986830ff2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.034738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 979/1952] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:39 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:40.037205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.043477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8d5f6490bc44d6b8f625986830ff2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.044154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8d5f6490bc44d6b8f625986830ff2b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.046879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8525-7c9d-4d26-a677-9cdf3c696792 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:40.051390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 974/1953] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:39 2022] DELETE /identity/v3/users/de8d5f6490bc44d6b8f625986830ff2b => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:40.058740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:40.059717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.060131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.060504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.061348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:40.088128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38c29-3088-404c-9aad-77e6d5d28a27 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.105086 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 980/1954] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:40.110080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.112040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:40.200023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730151-3462-4eca-8c08-aae5a4da5586 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:40.208454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:40.210318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.210318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.210318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] PATH_INFO: `/v3/projects/bdd6a6d31db447c99cef53e0e5d775df/users/6a5eec85d5bb4aba8845aecaca01b50b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.232126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd6a6d31db447c99cef53e0e5d775df, user_id=6a5eec85d5bb4aba8845aecaca01b50b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:40.259092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.313461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 975/1955] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:40 2022] PUT /identity/v3/projects/bdd6a6d31db447c99cef53e0e5d775df/users/6a5eec85d5bb4aba8845aecaca01b50b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:40.326773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.327449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.328035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.369536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] MFA Rules not processed for user `6a5eec85d5bb4aba8845aecaca01b50b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:40.370760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:40.470508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 981/1956] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:40.478877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.561903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.563583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:40.599273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9466c-ecb2-4579-a76a-8181f4e5e90a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:40.609690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:40.610262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.610526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.610918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.611624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:40.639030 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.669347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49e6e8-521d-451d-98bc-17465f5c9d34 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:40.676623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:40.678479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.678997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.679483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] PATH_INFO: `/v3/projects/c12e9889d4524998949ba156d5e999d3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.680950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12e9889d4524998949ba156d5e999d3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:40.709781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.725671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 976/1957] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:40 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:40.730368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.834290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6adc-fbed-4ef7-857c-cd5fd09a9a16 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:40.848818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12e9889d4524998949ba156d5e999d3', 'request_id': 'req-a66daaa7-70ea-472c-a26d-1c204f5d4615'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.872341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12e9889d4524998949ba156d5e999d3', 'request_id': 'req-a66daaa7-70ea-472c-a26d-1c204f5d4615'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.878420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12e9889d4524998949ba156d5e999d3', 'request_id': 'req-a66daaa7-70ea-472c-a26d-1c204f5d4615'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.917308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:40.918075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:40.918376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:40.918662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:40.919341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:40.946815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:40.969570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] The token cache is being invalidate because project c12e9889d4524998949ba156d5e999d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:40.969856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.970479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:40.974739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 982/1958] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:40 2022] DELETE /identity/v3/projects/c12e9889d4524998949ba156d5e999d3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:40.975765 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:40.976979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:40.993291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66daaa7-70ea-472c-a26d-1c204f5d4615 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.001147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.002055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.002399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.002773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] PATH_INFO: `/v3/users/d77af76993d54389b340a40a220d333b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.004175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77af76993d54389b340a40a220d333b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.036505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.043571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 977/1959] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:40 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:41.044107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.046032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:41.061054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532224-0aad-4ea5-be72-0df7a35cbf8f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.067424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.068204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.068886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.069175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.070386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.097093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.109117 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 978/1960] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:41.114020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.123454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2f7b5-b8e4-4e6a-958e-a96b23a0873a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.127909 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.129002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.129858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.130231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] PATH_INFO: `/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.151255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5de65c0314caa84c525bd719f4e7d, user_id=e2baa45ddcf54208a1734087dea91339, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.179199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.236693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77af76993d54389b340a40a220d333b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:41.245335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77af76993d54389b340a40a220d333b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:41.307174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 979/1961] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:41 2022] PUT /identity/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:41.311000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.382056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb75-b80f-45f3-96a4-f68134271319 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.384093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77af76993d54389b340a40a220d333b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:41.386490 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.387090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.387654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.387654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.388338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.399754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77af76993d54389b340a40a220d333b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:41.400435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77af76993d54389b340a40a220d333b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:41.407746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 983/1962] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:40 2022] DELETE /identity/v3/users/d77af76993d54389b340a40a220d333b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:41.416229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.431537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 980/1963] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:41.433123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.434669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:41.525323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc2a1d-cccd-4e62-b228-dd391d1e9777 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.527732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.528570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.528850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.529128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] PATH_INFO: `/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.531454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5de65c0314caa84c525bd719f4e7d, user_id=e2baa45ddcf54208a1734087dea91339, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.558850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.570820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 984/1964] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:41 2022] PUT /identity/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:41.574781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.585108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acec5-81ae-4b22-9a2b-33beed47c0ba admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.663724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.664650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.665391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.666026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.666879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.705648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10be5-dbf8-44f8-a5af-26aaa5be4440 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.717674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 981/1965] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:41.721963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:41.732477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35564e-8517-4f70-ad0d-d0ac3e835f17 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:41.739139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:41.740011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.740318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.740570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] PATH_INFO: `/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.742472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5de65c0314caa84c525bd719f4e7d, user_id=e2baa45ddcf54208a1734087dea91339, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:41.777498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:41.860928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 985/1966] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:41 2022] PUT /identity/v3/projects/a4b5de65c0314caa84c525bd719f4e7d/users/e2baa45ddcf54208a1734087dea91339/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:41.873159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:41.873762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:41.874276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:41.977396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] MFA Rules not processed for user `e2baa45ddcf54208a1734087dea91339`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:41.978611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:42.078213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 982/1967] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:42.079013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:42.081149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:42.085286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:42.086978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:42.169424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223911c-0a6d-435e-ac8d-1514e8275914 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:42.170623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d57e7-f9ac-431f-901e-39a9db3b95f6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:42.173881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:42.174717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.175005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.175241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:42.175360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] PATH_INFO: `/v3/projects/9c3ca6a72078440591d8dd3d82346668` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.176863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.177175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3ca6a72078440591d8dd3d82346668)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:42.177296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.177749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.190527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:42.202803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:42.217887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc377c-6336-4428-b4c4-1a556bebafc4 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:42.228525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 983/1968] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:42.327217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3ca6a72078440591d8dd3d82346668', 'request_id': 'req-eed541e7-baf7-4694-9f67-1a54897d8283'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:42.347883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3ca6a72078440591d8dd3d82346668', 'request_id': 'req-eed541e7-baf7-4694-9f67-1a54897d8283'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:42.354241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3ca6a72078440591d8dd3d82346668', 'request_id': 'req-eed541e7-baf7-4694-9f67-1a54897d8283'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:42.462215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] The token cache is being invalidate because project 9c3ca6a72078440591d8dd3d82346668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:42.462527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:42.463367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-eed541e7-baf7-4694-9f67-1a54897d8283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:42.465299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 986/1969] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:42 2022] DELETE /identity/v3/projects/9c3ca6a72078440591d8dd3d82346668 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:42.469749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.470079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.470374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.505641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:42.507120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:42.593725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 984/1970] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:42.595515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.595812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.596096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.619148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:42.621127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:42.635090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 987/1971] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:42.645050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:42.655959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fe5e2-60f3-40a6-a7ad-ea90451a6508 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:42.662121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:42.662892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.663186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.663518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.664732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:42.664732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:42.699846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:42.722020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 985/1972] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:42.727289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:42.736381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925399d7-93a6-4240-9d1b-aa7268812acc None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:42.746224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:42.746224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.746224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.746224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.746656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:42.774487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:42.883308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 988/1973] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:42 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:42.884447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:42.897710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73d11-a9e6-4f3f-8647-e16b1f256099 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:42.991524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:42.992153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:42.992449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:42.992735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:42.996280 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.063768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:43.170419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 986/1974] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:42 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:43.176600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:43.193178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aaefb-04b9-4ee5-9bdb-a27e76f61041 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:43.203099 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:43.204022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.204415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.204793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.205734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.241894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:43.253657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 989/1975] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:43.257538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:43.268178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564273-2178-4a1d-91d6-7a54b61d1147 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:43.273809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:43.274835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.275350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.275778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] PATH_INFO: `/v3/projects/0cac173a057140f6b3b91b5934864915/users/7765483068ff4758ad89371e5ba38df6/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.304130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cac173a057140f6b3b91b5934864915, user_id=7765483068ff4758ad89371e5ba38df6, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.339256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2aee-05a9-4b19-a439-4f71a49a3148 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:43.340126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:43.343165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.359919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e245d7-fcf4-4348-9441-1d8785391464 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:43.362621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:43.364281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.364640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.364986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] PATH_INFO: `/v3/users/6a5eec85d5bb4aba8845aecaca01b50b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.366227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5eec85d5bb4aba8845aecaca01b50b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.397652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:43.472269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 987/1976] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:43 2022] PUT /identity/v3/projects/0cac173a057140f6b3b91b5934864915/users/7765483068ff4758ad89371e5ba38df6/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:43.484239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.484624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.485098 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.555942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] MFA Rules not processed for user `7765483068ff4758ad89371e5ba38df6`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:43.557108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.639266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5eec85d5bb4aba8845aecaca01b50b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:43.664500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5eec85d5bb4aba8845aecaca01b50b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:43.674994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 988/1977] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:43.687264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:43.688769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.733773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5eec85d5bb4aba8845aecaca01b50b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:43.749092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5eec85d5bb4aba8845aecaca01b50b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:43.750289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28aa229a-8450-488a-a31c-a4712bf13967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5eec85d5bb4aba8845aecaca01b50b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:43.757119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 990/1978] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:43 2022] DELETE /identity/v3/users/6a5eec85d5bb4aba8845aecaca01b50b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:43.761380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.761676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.761979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.768213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf65958-77d3-47a6-a406-cf8cd0b19632 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:43.786680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:43.787832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.842918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:43.844010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.844478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.844767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.847477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.863898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 991/1979] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:43.874801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:43.876326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:43.928173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.953436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b818-c32c-43b1-a5c3-2e27c5babcf6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:43.953618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:43.957719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:43.958128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:43.958413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:43.958701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:43.964022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 989/1980] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:43.969878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:43.997794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:44.009557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 992/1981] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:19:44.505311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:44.506506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:44.521278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af6481-4a83-4b03-a12e-be2c001a09e8 service glance] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:44.528247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:44.529051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:44.529340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:44.529622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] PATH_INFO: `/v3/projects/bdd6a6d31db447c99cef53e0e5d775df` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:44.530750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd6a6d31db447c99cef53e0e5d775df)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:44.557210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:44.684339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd6a6d31db447c99cef53e0e5d775df', 'request_id': 'req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:44.763735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd6a6d31db447c99cef53e0e5d775df', 'request_id': 'req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:44.786444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd6a6d31db447c99cef53e0e5d775df', 'request_id': 'req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:44.835764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] The token cache is being invalidate because project bdd6a6d31db447c99cef53e0e5d775df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:44.836414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:44.837467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:44.855303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 990/1982] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:44 2022] DELETE /identity/v3/projects/bdd6a6d31db447c99cef53e0e5d775df => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:44.863444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:44.873703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867f4d-074a-494f-9843-d75e1fdea912 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:44.968233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:44.969045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:44.969335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:44.969617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] PATH_INFO: `/v3/users/e2baa45ddcf54208a1734087dea91339` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:44.970868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2baa45ddcf54208a1734087dea91339)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:45.008691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:45.186882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2baa45ddcf54208a1734087dea91339'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:45.195232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2baa45ddcf54208a1734087dea91339'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:45.276356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2baa45ddcf54208a1734087dea91339'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:45.289830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2baa45ddcf54208a1734087dea91339'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:45.290921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-41ae1c36-6e75-4b42-bbf9-d0f0e59ed1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2baa45ddcf54208a1734087dea91339'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:45.296509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 993/1983] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:44 2022] DELETE /identity/v3/users/e2baa45ddcf54208a1734087dea91339 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:45.839293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:45.840717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:45.853796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819ee0d-f641-4d2a-93ad-c21ae588b7fd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:45.930781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:45.931720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:45.932018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:45.932307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] PATH_INFO: `/v3/projects/a4b5de65c0314caa84c525bd719f4e7d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:45.933453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b5de65c0314caa84c525bd719f4e7d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:45.970754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:46.096509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b5de65c0314caa84c525bd719f4e7d', 'request_id': 'req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:46.179363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b5de65c0314caa84c525bd719f4e7d', 'request_id': 'req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:46.192200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b5de65c0314caa84c525bd719f4e7d', 'request_id': 'req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:46.203659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] The token cache is being invalidate because project a4b5de65c0314caa84c525bd719f4e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:46.204171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:46.204907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6194140c-dbc3-42ac-8ed1-69c6c8ad94a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:46.207042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 991/1984] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:45 2022] DELETE /identity/v3/projects/a4b5de65c0314caa84c525bd719f4e7d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:46.212634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.212634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.213163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.249153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:46.250452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:46.357272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 994/1985] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:46.359163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.359533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.359898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.395800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:46.397274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:46.405191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 992/1986] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:46.417921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:46.420295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6a44-cdd7-46d6-8314-9a5391ce0add None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:46.425090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:46.426402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.426946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.427287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.427934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:19:46.428362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:46.474199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:46.490430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 995/1987] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:19:46.494601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:46.506089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44a0ee-60d8-4263-9c57-9878700e995e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:46.510930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:46.511652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.511960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.512229 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.512897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:46.540817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:46.627133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 993/1988] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:46 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:46.631929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:46.642045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee117e8-0641-4f96-ba0e-9d8c04faced9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:46.714630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:46.715386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.716066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.716066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.716604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:46.743490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:46.819692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 996/1989] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:46 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:46.823971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:46.835060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dc787-d552-4406-a2d1-e76c12ee9554 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:46.840571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:46.841139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.841406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.841738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.842474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:46.869320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74e79e-2ffa-4b26-9c16-7371471087e9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:46.883379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 994/1990] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:46.894717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:46.924214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38e55e-8b3d-43f9-aeb3-1cda8a9b7b1b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:46.924214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:46.924214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:46.924214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:46.924633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] PATH_INFO: `/v3/projects/fd7dc7b25380483ea7328e23a7c2c7ea/users/8436edce19eb46c7ba4d01c6973ff423/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:46.937171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7dc7b25380483ea7328e23a7c2c7ea, user_id=8436edce19eb46c7ba4d01c6973ff423, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:46.965691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:47.036979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 997/1991] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:46 2022] PUT /identity/v3/projects/fd7dc7b25380483ea7328e23a7c2c7ea/users/8436edce19eb46c7ba4d01c6973ff423/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:47.047127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.047451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.047742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.087418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] MFA Rules not processed for user `8436edce19eb46c7ba4d01c6973ff423`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:47.088575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:47.161260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 995/1992] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:47.165553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:47.252205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946feb34-3948-4004-9e05-479e34f18315 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:47.258095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:47.258775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.259176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.259526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.260244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:47.294171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:47.388831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 998/1993] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:47 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:47.393246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:47.404529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb883ce-c992-44e6-ba25-f01503f7d577 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:47.476303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:47.476919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.477212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.477494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.478214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:47.505387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:47.628565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 996/1994] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:47 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:47.630232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:47.644855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56a4b-a7a8-4a69-ada3-8b5ff54b5716 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:47.656643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:47.657258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.657550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.657825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.658612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:47.684922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620e361-6aff-4299-9618-b44e9bf0a4e0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:47.697840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 999/1995] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:47.702173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:47.715467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091c5b4-3838-44f2-bc41-b434e4161769 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:47.719796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:47.720617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.720906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.721188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] PATH_INFO: `/v3/projects/fbe180eae3ae486091b1f74f06259948/users/21cebe2c2cda4aabbbaf85096cad36a1/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.760283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe180eae3ae486091b1f74f06259948, user_id=21cebe2c2cda4aabbbaf85096cad36a1, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:47.788623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:47.859696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 997/1996] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:47 2022] PUT /identity/v3/projects/fbe180eae3ae486091b1f74f06259948/users/21cebe2c2cda4aabbbaf85096cad36a1/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:47.871591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:47.871884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:47.872172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:47.912022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] MFA Rules not processed for user `21cebe2c2cda4aabbbaf85096cad36a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:47.913332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:47.994308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1000/1997] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:47.998739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.084779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea4600-5dc8-4ac5-84a8-464f0c383598 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.089069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.089662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.089981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.090269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.090914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.117489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.203528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 998/1998] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:19:47 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:19:48.210125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.217983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e75fa2-2b33-467f-8af4-9c2d91f2b2a8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.281192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.282114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.282199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.282439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.283082 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.308416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.443727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1001/1999] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:19:48 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:19:48.444965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.455138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0416621-c406-4f2f-a8b6-bd97d7182df7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.468241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.469196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.469585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.469993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.480255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.512313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.525126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 999/2000] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:48.529004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.540046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea392885-c20c-437e-8199-a7c86138b2f2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.545193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.546231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.546625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.547012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] PATH_INFO: `/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.573337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61366cb336f2421183338dfeca926521, user_id=f5dd7fe13983487b890e4cd512aaa734, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.603239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.714470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1002/2001] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:48 2022] PUT /identity/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:48.719141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.736740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eac9a-7622-4f96-a99d-3e4aaea520d0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.803685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.804693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.804869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.805345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.806152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.833725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.860896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1000/2002] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:19:48.866998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.888646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b983-d1b9-41a2-a2bb-f2d796ae5a83 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:48.895335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:48.896647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:48.896647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:48.896971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] PATH_INFO: `/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:48.899153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=61366cb336f2421183338dfeca926521, user_id=f5dd7fe13983487b890e4cd512aaa734, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:48.933438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:48.971909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1003/2003] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:48 2022] PUT /identity/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:48.976404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:48.986735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7869a-fe49-4b5d-a651-8f60ddb955b7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:49.088717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:49.089437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:49.090068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:49.090533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:49.091668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:49.120976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855630a-1e93-4557-95d7-768f37a300a7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:49.137301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1001/2004] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:19:49.139029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:49.157498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278742f0-5c39-48f6-be8c-15060bada1ef admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:49.171768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:49.172754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:49.173138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:49.174028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] PATH_INFO: `/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:49.178777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61366cb336f2421183338dfeca926521, user_id=f5dd7fe13983487b890e4cd512aaa734, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:49.211071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:49.289690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1004/2005] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:19:49 2022] PUT /identity/v3/projects/61366cb336f2421183338dfeca926521/users/f5dd7fe13983487b890e4cd512aaa734/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:19:49.299847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:49.300944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:49.301602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:49.340488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] MFA Rules not processed for user `f5dd7fe13983487b890e4cd512aaa734`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:49.341666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:49.433119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1002/2006] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:19:49.443466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:49.445259 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:49.543055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7aaf6-8a21-40de-a714-eaacb312f62b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:49.548077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:49.548892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:49.549185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:49.549636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:49.566316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:49.601316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:49.620557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1005/2007] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:49.765479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:49.775659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfd5e9-fc7b-4400-8ff6-a7c4796e4028 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:49.779304 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:49.779794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:49.780111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:49.780417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:49.846860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:49.872659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225572-5862-4471-9b86-3ca35f99022c service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:49.882779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1003/2008] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:57.617587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:57.728945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc5dc6-4f11-4371-bef2-8e0145645520 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:57.739901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:57.740900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:57.741369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:57.745989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] PATH_INFO: `/v3/users/8436edce19eb46c7ba4d01c6973ff423` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:57.745989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8436edce19eb46c7ba4d01c6973ff423)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:57.796498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:58.042907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8436edce19eb46c7ba4d01c6973ff423'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:58.051400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8436edce19eb46c7ba4d01c6973ff423'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:58.145506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8436edce19eb46c7ba4d01c6973ff423'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:58.159900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8436edce19eb46c7ba4d01c6973ff423'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:58.160885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8436edce19eb46c7ba4d01c6973ff423'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:58.167301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1006/2009] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:57 2022] DELETE /identity/v3/users/8436edce19eb46c7ba4d01c6973ff423 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:58.173058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:58.179050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:58.179050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:58.196568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:19:58.198344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:58.268455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1004/2010] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:19:58.279557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:58.281452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:58.369141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb312a-e514-43a7-89ad-f21be88bf493 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:58.373389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:58.374032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:58.374328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:58.374802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:58.387810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:58.415822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:58.426929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1007/2011] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:19:59.281394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:59.282784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:19:59.296771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6fa3-3068-4fbe-baa5-a14095b72ec8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:59.301444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:59.302454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:59.302900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:59.303254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] PATH_INFO: `/v3/projects/fd7dc7b25380483ea7328e23a7c2c7ea` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:59.304431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7dc7b25380483ea7328e23a7c2c7ea)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:59.331858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:59.449350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7dc7b25380483ea7328e23a7c2c7ea', 'request_id': 'req-d211776b-15d1-43a5-91f4-c94ee86adc8a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.545282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7dc7b25380483ea7328e23a7c2c7ea', 'request_id': 'req-d211776b-15d1-43a5-91f4-c94ee86adc8a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.562812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7dc7b25380483ea7328e23a7c2c7ea', 'request_id': 'req-d211776b-15d1-43a5-91f4-c94ee86adc8a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.578221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] The token cache is being invalidate because project fd7dc7b25380483ea7328e23a7c2c7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:19:59.579015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.580933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.584448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1005/2012] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:19:59 2022] DELETE /identity/v3/projects/fd7dc7b25380483ea7328e23a7c2c7ea => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:19:59.588465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:19:59.600831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713cfad-a347-4058-a4ce-8c5e9f989688 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:19:59.673909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:19:59.675737 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:19:59.676374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:19:59.677286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] PATH_INFO: `/v3/users/21cebe2c2cda4aabbbaf85096cad36a1` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:19:59.678803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cebe2c2cda4aabbbaf85096cad36a1)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:19:59.704853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:19:59.909826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cebe2c2cda4aabbbaf85096cad36a1'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:19:59.918901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cebe2c2cda4aabbbaf85096cad36a1'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.002612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cebe2c2cda4aabbbaf85096cad36a1'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.021885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cebe2c2cda4aabbbaf85096cad36a1'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.022627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cebe2c2cda4aabbbaf85096cad36a1'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.029174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1008/2013] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:19:59 2022] DELETE /identity/v3/users/21cebe2c2cda4aabbbaf85096cad36a1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:00.257951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:00.259295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:00.271543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211776b-15d1-43a5-91f4-c94ee86adc8a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:00.350412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:00.351380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:00.351679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:00.352083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] PATH_INFO: `/v3/users/05739bc0782347e0acbf5e528429ce93` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:00.353190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05739bc0782347e0acbf5e528429ce93)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:00.378910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:00.570955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:00.572318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:00.584461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea553a-de8a-4ba4-8677-f932c158eb80 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:00.588980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:00.589780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:00.590032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:00.590316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] PATH_INFO: `/v3/projects/fbe180eae3ae486091b1f74f06259948` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:00.591628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe180eae3ae486091b1f74f06259948)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:00.619305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:00.648119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05739bc0782347e0acbf5e528429ce93'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.710747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05739bc0782347e0acbf5e528429ce93'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.729181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05739bc0782347e0acbf5e528429ce93'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.733714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05739bc0782347e0acbf5e528429ce93'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.734289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-955b10ea-66c7-4b9a-b6c1-b8b397e28e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05739bc0782347e0acbf5e528429ce93'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.741317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1006/2014] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:00 2022] DELETE /identity/v3/users/05739bc0782347e0acbf5e528429ce93 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:00.741696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe180eae3ae486091b1f74f06259948', 'request_id': 'req-913fd463-a99a-448f-a028-bfe7ea42ec14'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.745546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:00.750174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:00.750174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:00.752836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe180eae3ae486091b1f74f06259948', 'request_id': 'req-913fd463-a99a-448f-a028-bfe7ea42ec14'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.758059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe180eae3ae486091b1f74f06259948', 'request_id': 'req-913fd463-a99a-448f-a028-bfe7ea42ec14'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.770198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:00.771348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:00.812241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] The token cache is being invalidate because project fbe180eae3ae486091b1f74f06259948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:00.812523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.813119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:00.814590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1009/2015] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:00 2022] DELETE /identity/v3/projects/fbe180eae3ae486091b1f74f06259948 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:20:00.819206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:00.824779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:00.836130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1007/2016] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:00.846467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:00.848244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:00.896404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fd463-a99a-448f-a028-bfe7ea42ec14 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:00.901119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:00.901925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:00.902240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:00.902522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] PATH_INFO: `/v3/users/f5dd7fe13983487b890e4cd512aaa734` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:00.903627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5dd7fe13983487b890e4cd512aaa734)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:00.915644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72246b22-845f-4d00-816b-7ef54d595643 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:00.918936 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:00.919518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:00.919807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:00.920112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:00.928807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:00.928944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:00.954354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:00.977999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1008/2017] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:20:01.149843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5dd7fe13983487b890e4cd512aaa734'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.158734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5dd7fe13983487b890e4cd512aaa734'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.236520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5dd7fe13983487b890e4cd512aaa734'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.249963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5dd7fe13983487b890e4cd512aaa734'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.254344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-bb7a8c25-9c26-4f80-82a7-8ce5b92e354c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5dd7fe13983487b890e4cd512aaa734'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.257464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1010/2018] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:00 2022] DELETE /identity/v3/users/f5dd7fe13983487b890e4cd512aaa734 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:20:01.461685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:01.463128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:01.475960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1e62-aff5-4638-9e50-6c8b8b53485e service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:01.546058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:01.546886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:01.547172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:01.547468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] PATH_INFO: `/v3/projects/3857690a945d4b1ea5a6a439f00b8218` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:01.548543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3857690a945d4b1ea5a6a439f00b8218)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:01.575322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:01.724824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3857690a945d4b1ea5a6a439f00b8218', 'request_id': 'req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.813409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3857690a945d4b1ea5a6a439f00b8218', 'request_id': 'req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.825904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3857690a945d4b1ea5a6a439f00b8218', 'request_id': 'req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.838457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] The token cache is being invalidate because project 3857690a945d4b1ea5a6a439f00b8218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:01.840330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.840330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-228fb336-7a7b-4a05-a656-9b9b6cb6cdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:01.841981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1009/2019] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:01 2022] DELETE /identity/v3/projects/3857690a945d4b1ea5a6a439f00b8218 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:01.846246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:01.846625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:01.846821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:01.871896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:01.873059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:01.951664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1011/2020] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:01.959453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:01.959750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:01.960036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:01.989866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:01.991065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.013431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.014256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1010/2021] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:02.026956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd440-23d5-43b0-a082-68ab4bfa44fc None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.034208 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.035633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.036076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.036367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.037144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:20:02.037593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.039158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.040663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.054964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40449dc-db18-4604-a9be-a8200c5afa9b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.059798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.060641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.060938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.061228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] PATH_INFO: `/v3/projects/61366cb336f2421183338dfeca926521` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.062617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61366cb336f2421183338dfeca926521)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.066040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.082497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1012/2022] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:20:02.086899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.089418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.096166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eab90-c891-402d-8718-7fb8afadf836 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.101010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.101591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.101879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.102918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.102918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.131377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.244010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61366cb336f2421183338dfeca926521', 'request_id': 'req-56ac2ce9-3da1-49ae-acb3-ab80e0333765'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:02.287996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1013/2023] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:20:02.291939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.355289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61366cb336f2421183338dfeca926521', 'request_id': 'req-56ac2ce9-3da1-49ae-acb3-ab80e0333765'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:02.367305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e8dfb-502d-4f04-8670-c7a96267dbdc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.373175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.374012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.374295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.374578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.375156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61366cb336f2421183338dfeca926521', 'request_id': 'req-56ac2ce9-3da1-49ae-acb3-ab80e0333765'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:02.375282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.387348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] The token cache is being invalidate because project 61366cb336f2421183338dfeca926521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:02.387771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:02.388556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-56ac2ce9-3da1-49ae-acb3-ab80e0333765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:02.390270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1011/2024] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:02 2022] DELETE /identity/v3/projects/61366cb336f2421183338dfeca926521 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:02.399974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee81c14-c395-422e-bdd8-114111a1302c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.400431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee81c14-c395-422e-bdd8-114111a1302c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.400548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee81c14-c395-422e-bdd8-114111a1302c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.404174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.426294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-dee81c14-c395-422e-bdd8-114111a1302c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:02.427135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dee81c14-c395-422e-bdd8-114111a1302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.448976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1012/2025] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:02.450426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.450774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.451071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.476182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:02.477242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.491812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1013/2026] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:02.499857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.509000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2f96f-5836-4f69-8e17-9f4df901d785 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.513255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.513814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.514168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.514453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.515133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:20:02.515429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.530995 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1014/2027] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:20:02.531989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.533471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.542018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.544625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283763a-fd15-4438-b889-922498c41990 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.548851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.549435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.549719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.550034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.551047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.559033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1014/2028] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:20:02.560178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.570298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16814-aae5-4057-9444-5d9efcb13101 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.574492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.575058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.575367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.575648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.576266 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.576961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.588524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1015/2029] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:02.593585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.605495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3e561-3e00-42ac-bab2-b32d38501ff1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.606029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.611106 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.612386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.612743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.613631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] PATH_INFO: `/v3/projects/43042ad2ff7f4858b375b74b2a328a73/users/02c87927accc44e1b16265ed6f012fdb/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.635882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43042ad2ff7f4858b375b74b2a328a73, user_id=02c87927accc44e1b16265ed6f012fdb, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.663242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78444c40-e482-41b2-9ec8-9303d001317f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.695080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1015/2030] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:20:02.699248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.763026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1016/2031] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:02 2022] PUT /identity/v3/projects/43042ad2ff7f4858b375b74b2a328a73/users/02c87927accc44e1b16265ed6f012fdb/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:02.768676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b776a-41e0-4f4e-a725-f6df002746b0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.773657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.773985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.774274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.809671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] MFA Rules not processed for user `02c87927accc44e1b16265ed6f012fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:02.810849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.831469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.832641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.832933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.833218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.833848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.859719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:02.883394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1017/2032] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:02.893646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.902398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:02.958843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b585f-6616-4570-b061-b553c9460b34 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.962404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.962992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.963281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.965569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.971808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1016/2033] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:02 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:20:02.974314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:02.980951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:02.986146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fdb1-cef5-4edf-a39d-49169c65f57b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:02.991558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:02.992164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:02.992572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:02.992865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:02.993567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:03.001514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.011900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1018/2034] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:20:03.020317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beeb78-fb33-4d97-a359-448b40ee59fb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.032129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1017/2035] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:03.040596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:03.060638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b604db-021a-4715-9bf3-81743bd3291c service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:03.065724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:03.066726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.067091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.067440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] PATH_INFO: `/v3/projects/9e720aef49884bcab63ba8a339885409/users/5906385a994f4768a6b32154767f30da/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.088527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e720aef49884bcab63ba8a339885409, user_id=5906385a994f4768a6b32154767f30da, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:03.118199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.225105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1019/2036] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:03 2022] PUT /identity/v3/projects/9e720aef49884bcab63ba8a339885409/users/5906385a994f4768a6b32154767f30da/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:03.237082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.237629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.238579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.276215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] MFA Rules not processed for user `5906385a994f4768a6b32154767f30da`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:03.277383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:03.362133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1018/2037] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:03.366537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:03.436165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1212b5-efa0-47f2-b7ba-f96cd8b9abff admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:03.440498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:03.441089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.441444 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.441721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.442393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:03.468853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.670994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1020/2038] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:03 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:03.675217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:03.685756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952caed0-4f94-4046-822d-6ddaaabf35af None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:03.760310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:03.765154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.765154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.765154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.765154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:03.789279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.888413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1019/2039] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:03 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:03.896076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:03.905602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77e0d-e8b2-4e9f-957a-d103e2574766 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:03.910175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:03.910960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.911064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.911341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.912041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:03.937248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:03.949426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1021/2040] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:03.953579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:03.964279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01216d50-f54b-4773-88d6-2af189a8e7f3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:03.968490 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:03.969291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:03.969577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:03.969856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] PATH_INFO: `/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:03.990190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59261b3ec4834482befb56e7fd70481a, user_id=fb635d3b799a4a8cb4076af024c7cd84, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.017357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.126829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1020/2041] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:03 2022] PUT /identity/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:04.131436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:04.141271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d80c5c-7f3c-4f6c-9c0f-2dee65a575c8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:04.202621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:04.203222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.203510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.203789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.204479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.229870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.240747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1022/2042] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:04.245053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:04.255809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef059395-1678-45d0-948e-6b947320c6c0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:04.260482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:04.261347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.261633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.261925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] PATH_INFO: `/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.263733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=59261b3ec4834482befb56e7fd70481a, user_id=fb635d3b799a4a8cb4076af024c7cd84, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.291780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.302995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1021/2043] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:04 2022] PUT /identity/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:04.306947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:04.317213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121894a3-ef7d-47aa-9a52-b71273c8b3bf admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:04.388787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:04.389314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.389605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.389888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.390625 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.417771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d608224-e2fc-4700-9036-9c534b980997 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.431275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1023/2044] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:04.435529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:04.446343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59bfb7-b5db-4852-86a9-2ac0ce75b4cf admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:04.455922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:04.455922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.455922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.455922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] PATH_INFO: `/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.456271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59261b3ec4834482befb56e7fd70481a, user_id=fb635d3b799a4a8cb4076af024c7cd84, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.481022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.615663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1022/2045] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:04 2022] PUT /identity/v3/projects/59261b3ec4834482befb56e7fd70481a/users/fb635d3b799a4a8cb4076af024c7cd84/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:20:04.625839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.626171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.626457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.668119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] MFA Rules not processed for user `fb635d3b799a4a8cb4076af024c7cd84`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:04.669388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:04.750203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1024/2046] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:04.760998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:04.836562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3725b-0b67-4909-8441-2d7d95031a3f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:04.840198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:04.840915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:04.841271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:04.841617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:04.853848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:04.879578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:04.889357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1023/2047] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:20:05.060492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:05.070758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa51c4-1484-49df-912f-296c170d0431 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:05.074629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:05.075771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:05.075771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:05.076037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:05.163080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:05.200581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43149e-3990-45e8-a950-22394c857d87 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:05.210528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1025/2048] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:06.008961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:06.085733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca80d-c7c5-45bf-b5cc-f2eef01e9a26 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:06.091704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:06.093052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:06.093575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:06.094132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] PATH_INFO: `/v3/users/5906385a994f4768a6b32154767f30da` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:06.095476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5906385a994f4768a6b32154767f30da)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:06.122575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:06.319000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5906385a994f4768a6b32154767f30da'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:06.384727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5906385a994f4768a6b32154767f30da'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:06.392897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5906385a994f4768a6b32154767f30da'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:06.405002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5906385a994f4768a6b32154767f30da'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:06.405599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5906385a994f4768a6b32154767f30da'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:06.411507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1024/2049] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:06 2022] DELETE /identity/v3/users/5906385a994f4768a6b32154767f30da => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:06.416162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:06.416631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:06.416804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:06.439075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:06.440298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:06.508704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1026/2050] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:06.519366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:06.521363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:06.583787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04421e7-2208-43c1-ba52-154ab0a9ce03 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:06.587996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:06.588587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:06.588878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:06.589161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:06.598772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:06.624625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:06.634534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1025/2051] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:07.231450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:07.232853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:07.252263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1933d-dfb1-42c1-8bd0-24c57b189b16 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:07.264194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:07.267277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:07.267509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:07.267940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] PATH_INFO: `/v3/projects/9e720aef49884bcab63ba8a339885409` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:07.272405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e720aef49884bcab63ba8a339885409)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:07.298781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:07.437767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e720aef49884bcab63ba8a339885409', 'request_id': 'req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.449242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e720aef49884bcab63ba8a339885409', 'request_id': 'req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.454334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e720aef49884bcab63ba8a339885409', 'request_id': 'req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.527613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] The token cache is being invalidate because project 9e720aef49884bcab63ba8a339885409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:07.528190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.528999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.530932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1027/2052] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:07 2022] DELETE /identity/v3/projects/9e720aef49884bcab63ba8a339885409 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:07.534806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:07.544880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd6bc0-e87c-45b2-94b1-f37839904f15 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:07.613366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:07.614338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:07.614624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:07.614907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] PATH_INFO: `/v3/users/fb635d3b799a4a8cb4076af024c7cd84` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:07.616027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb635d3b799a4a8cb4076af024c7cd84)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:07.642827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:07.862619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb635d3b799a4a8cb4076af024c7cd84'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.920372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb635d3b799a4a8cb4076af024c7cd84'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.928821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb635d3b799a4a8cb4076af024c7cd84'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.940753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb635d3b799a4a8cb4076af024c7cd84'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.941430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b440a339-febd-42c4-b089-9891dd086af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb635d3b799a4a8cb4076af024c7cd84'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:07.947869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1026/2053] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:07 2022] DELETE /identity/v3/users/fb635d3b799a4a8cb4076af024c7cd84 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:08.593258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:08.594825 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:08.618167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa414e-d17f-4699-9b06-f90ff3aa3be3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:08.694056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:08.694631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:08.695646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:08.696207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] PATH_INFO: `/v3/projects/59261b3ec4834482befb56e7fd70481a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:08.697634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59261b3ec4834482befb56e7fd70481a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:08.724640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:08.885278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59261b3ec4834482befb56e7fd70481a', 'request_id': 'req-369fce31-576c-42f8-a598-4c2825e3d571'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:08.897593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59261b3ec4834482befb56e7fd70481a', 'request_id': 'req-369fce31-576c-42f8-a598-4c2825e3d571'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:08.903080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59261b3ec4834482befb56e7fd70481a', 'request_id': 'req-369fce31-576c-42f8-a598-4c2825e3d571'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:08.979249 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] The token cache is being invalidate because project 59261b3ec4834482befb56e7fd70481a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:08.979768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:08.981207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-369fce31-576c-42f8-a598-4c2825e3d571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:08.983732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1028/2054] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:08 2022] DELETE /identity/v3/projects/59261b3ec4834482befb56e7fd70481a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:08.989534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:08.990023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:08.990534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.013419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:09.014585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:09.080387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1027/2055] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:09.089177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.089473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.089758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.117509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:09.117509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:09.124223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1029/2056] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:09.130237 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.140111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfb4cb-3fe7-448f-9fac-ddc970f285b5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.144712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.145870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.146320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.146608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.147296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:20:09.147592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:09.173179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:09.186845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1028/2057] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:20:09.197511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.200848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae495f0-4ba0-4d53-934d-5382f2e32333 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.205192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.205776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.206097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.206380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.207026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:09.241793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:09.317963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1030/2058] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:09 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:20:09.322320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.331897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c38e4-19de-46d3-9cea-87bd12850c0e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.396271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.396800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.397093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.397378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.398161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:09.424663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:09.508352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1029/2059] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:09 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:09.509559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.519643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d903-fbc8-4712-9636-669d05a260ca admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.524458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.525043 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.525328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.525605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.526332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:09.553341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc3cb-8154-4aad-b30d-3de62884acdc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:09.564220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1031/2060] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:09.568685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.578800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be893f63-4989-45c7-82ed-bc5b55510dd8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.583593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.584399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.584686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.585018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] PATH_INFO: `/v3/projects/91f7f62c94304833bc1a708e4712d093/users/6b2e736dfd70417bb880744a55b54cf9/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.605452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f7f62c94304833bc1a708e4712d093, user_id=6b2e736dfd70417bb880744a55b54cf9, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:09.631910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:09.745188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1030/2061] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:09 2022] PUT /identity/v3/projects/91f7f62c94304833bc1a708e4712d093/users/6b2e736dfd70417bb880744a55b54cf9/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:09.756639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.757264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.757264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.795565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] MFA Rules not processed for user `6b2e736dfd70417bb880744a55b54cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:09.796697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:09.872668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1032/2062] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3704 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:09.884982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:09.887065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:09.961053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad697d0-10bf-4fcd-9b9b-79557b0746f5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:09.965697 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:09.966866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:09.966866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:09.966866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:09.986272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:10.017309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffe73c-dcd0-41c1-b308-3223451bb5a6 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:10.028363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1031/2063] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3704 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:23.354814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:23.425870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af701f-1712-4721-925e-b256323c9d11 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:23.431055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:23.431899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:23.432190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:23.434690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] PATH_INFO: `/v3/users/6b2e736dfd70417bb880744a55b54cf9` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:23.434690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2e736dfd70417bb880744a55b54cf9)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:23.486565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:23.771185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2e736dfd70417bb880744a55b54cf9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:23.779318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2e736dfd70417bb880744a55b54cf9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:23.893237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2e736dfd70417bb880744a55b54cf9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:23.906669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2e736dfd70417bb880744a55b54cf9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:23.907324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2e736dfd70417bb880744a55b54cf9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:23.913832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1033/2064] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:23 2022] DELETE /identity/v3/users/6b2e736dfd70417bb880744a55b54cf9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:23.918364 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:23.918808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:23.919049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:23.942217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:23.943462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:24.029631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1032/2065] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:24.040683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:24.042390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:24.114896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8d9a-d6e4-4ca7-8ea6-2ed6fc6c0821 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:24.118521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:24.119114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:24.119528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:24.119873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:24.129696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:24.156991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f0b4-2c05-4595-9239-ddecc9e78a08 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:24.167585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1034/2066] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:24.774202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:24.775619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:24.786861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739caeb-c1c2-4446-b971-3c712add82f6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:24.792272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:24.793275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:24.793619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:24.793902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] PATH_INFO: `/v3/projects/91f7f62c94304833bc1a708e4712d093` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:24.795036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f7f62c94304833bc1a708e4712d093)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:24.820880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:24.945211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f7f62c94304833bc1a708e4712d093', 'request_id': 'req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:25.133262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f7f62c94304833bc1a708e4712d093', 'request_id': 'req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:25.144993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f7f62c94304833bc1a708e4712d093', 'request_id': 'req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:25.156039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] The token cache is being invalidate because project 91f7f62c94304833bc1a708e4712d093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:20:25.156326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:25.156967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0fd0303-2d81-4d87-ae94-4bd8f80a54bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:25.158818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1033/2067] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:20:24 2022] DELETE /identity/v3/projects/91f7f62c94304833bc1a708e4712d093 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:25.164823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.165350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.165453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.187588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:25.188761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:25.258668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1035/2068] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:25.270591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.270922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.271550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.296560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:25.297753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:25.306750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1034/2069] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:25.311044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:25.321021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787ef68-87f8-4c6f-9930-81f5678baf61 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:25.327162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:25.327771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.328049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.328335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.329014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:20:25.331644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:25.358314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdec8dc-b9c8-4074-8b06-4778a9cb13d8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:25.373771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1036/2070] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:20:25.378510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:25.387756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079932a-821d-4ae5-865c-ed995deac86e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:25.392841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:25.393439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.393755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.394081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.394729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:25.420091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.420091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.420091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.422012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:25.446959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] MFA Rules not processed for user `00df2776f7024acc888a4c9b2e1cc891`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:25.448189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:25.512643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1037/2071] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:25.570067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1035/2072] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:25 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:25.574146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:25.585441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff017-02a7-4351-9448-69485d98d024 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:25.656079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:25.656698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.656986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.657313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.658097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:25.685511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:25.798447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1038/2073] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:25 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:25.802291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:25.812551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca404-996b-485a-aef5-bd2424ef8095 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:25.817089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:25.817901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.818227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.818511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.819259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:25.854907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b39c9a-496d-46e6-92d7-5e0af269f8ad admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:25.865603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1036/2074] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:25.869688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:25.881585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b2ddc-b5b9-4eca-8bc0-ccfdf8fd1b47 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:25.889878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:25.891074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:25.891367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:25.891653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] PATH_INFO: `/v3/projects/a5cf8fe4306446d985fb4a66132ccf62/users/c59b5476fb4a4c4b9ddd8f6ad6aee529/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:25.915387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cf8fe4306446d985fb4a66132ccf62, user_id=c59b5476fb4a4c4b9ddd8f6ad6aee529, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:25.996600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:26.105677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1039/2075] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:25 2022] PUT /identity/v3/projects/a5cf8fe4306446d985fb4a66132ccf62/users/c59b5476fb4a4c4b9ddd8f6ad6aee529/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:26.110617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a7d-1de1-48f0-af3a-45ff3f1d1977 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:26.111118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a7d-1de1-48f0-af3a-45ff3f1d1977 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:26.111366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda7a7d-1de1-48f0-af3a-45ff3f1d1977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:26.134526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-fcda7a7d-1de1-48f0-af3a-45ff3f1d1977 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:26.135672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fcda7a7d-1de1-48f0-af3a-45ff3f1d1977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:26.203858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1037/2076] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:26.215974 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:26.217960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:26.282774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4a58-97f6-4429-8a4e-14879b701199 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:26.286197 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:26.286784 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:26.287081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:26.287342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:26.297068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:26.323955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8ff71-67ba-4a1d-9ffa-87d891eb1c82 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:26.333731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1040/2077] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:31.308241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:31.310450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:31.310988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:31.344287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] MFA Rules not processed for user `16774d5cebcc40d8aea59afa90926050`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:31.351521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:31.444613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1038/2078] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:35.065752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae80-9181-4150-bc49-77e8429d1134 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:35.066729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae80-9181-4150-bc49-77e8429d1134 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:35.067225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aae80-9181-4150-bc49-77e8429d1134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:35.141862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-119aae80-9181-4150-bc49-77e8429d1134 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:35.145176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-119aae80-9181-4150-bc49-77e8429d1134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:35.328843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1041/2079] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:35.423411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:35.424917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:35.585271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae849-0348-40e5-ad5f-fb153ff7b84e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:35.591633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:35.592551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:35.592989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:35.593423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:35.623070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:35.688858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:35.702492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1039/2080] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:20:39.209702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:39.210244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:39.210344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:39.265434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] MFA Rules not processed for user `c59b5476fb4a4c4b9ddd8f6ad6aee529`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:39.267048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:39.422742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1042/2081] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:39.427840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:39.443741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680efce-8fa8-4b5e-b72b-0d1e97fbc368 service swift] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:39.449876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:39.450894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:39.451408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:39.462526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:39.463694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:39.502217 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:39.673403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:39.683415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1040/2082] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:39.688736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3791e2-356e-4af7-a455-b70cf2e37253 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:39.859310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:39.859935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:39.860225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:39.860868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:39.861530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:39.919298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:40.053538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1043/2083] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:20:39 2022] POST /identity/v3/users => generated 299 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:20:40.059191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:40.089366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68f5ab-b0a9-4b59-bab4-ec5751633405 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:40.105628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:40.107552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:40.109114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:40.109897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:40.114781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:40.206154 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:40.237791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:40.248820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1041/2084] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:40.250123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e984f-683b-4dc4-a8d5-961ca02c8f30 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:40.268653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:40.270313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:40.270691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:40.271078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] PATH_INFO: `/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:40.298788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c7813a87c4ef3a93cd6bcd742dca0, user_id=99773ef57b8049f7aec7e273dd995b00, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:40.331217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:40.455033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1044/2085] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:40 2022] PUT /identity/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:40.460365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:40.480626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fb401-a7d0-49a3-8736-22746f43e9fb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:40.633758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:40.636409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:40.637922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:40.638525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:40.639264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:40.688675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:40.708351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:40.710135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1042/2086] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:40.720780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3a69-aebd-47c8-a938-a01a657ac695 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:40.737788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:40.741223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:40.741519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:40.741810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] PATH_INFO: `/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:40.749747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c7813a87c4ef3a93cd6bcd742dca0, user_id=99773ef57b8049f7aec7e273dd995b00, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:40.836909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:40.885663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:40.898035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7038c-3b52-4061-a305-4a68d3544d7e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:40.898707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1045/2087] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:40 2022] PUT /identity/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:40.984817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:40.985811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:40.986722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:40.988291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:40.990714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:41.049311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:41.081641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:41.088136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1043/2088] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:20:41.088724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4d2d9-78b2-4815-ba3b-360b52595e78 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:41.093881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:41.095412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:41.095884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:41.096351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] PATH_INFO: `/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:41.101212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c7813a87c4ef3a93cd6bcd742dca0, user_id=99773ef57b8049f7aec7e273dd995b00, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:41.174570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114b32d-e42a-43ed-b72b-a8c663bff0db admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:41.282600 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1046/2089] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:20:41 2022] PUT /identity/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0/users/99773ef57b8049f7aec7e273dd995b00/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:53.133769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:53.136255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:53.332629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1ca9-fccf-4f29-8c9d-b12fb51c8d57 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:53.449713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:53.450447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:53.450756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:53.451048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:53.456900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:53.479291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:53.512598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:53.530091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1044/2090] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:54.468286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13416-321f-4297-9d6e-0a8886398868 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:54.468797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13416-321f-4297-9d6e-0a8886398868 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:54.468909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13416-321f-4297-9d6e-0a8886398868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:54.539313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-26c13416-321f-4297-9d6e-0a8886398868 None None] MFA Rules not processed for user `99773ef57b8049f7aec7e273dd995b00`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:54.540645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-26c13416-321f-4297-9d6e-0a8886398868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:54.637160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1047/2091] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:54.656348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:54.657786 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:54.767592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31fb2f-f69a-4067-a9ac-9776c7b77eb5 service placement] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:54.772850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:54.773656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:54.774142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:54.774593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:54.893595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:54.923585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:54.935620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1045/2092] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:54 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:20:55.308146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:55.310727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:55.310727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:55.460046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:55.461429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:55.651920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1048/2093] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:20:55.688673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:55.931156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae4638-babe-4b4f-9334-340958aa24bc service glance] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:55.957420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:55.959456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:55.959456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:55.959456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:55.995720 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:56.105718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82ee7-bdcb-4817-ba2b-b2f5c5f585ba service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:56.135472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1046/2094] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:20:58.510223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:58.511700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:58.732705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eee60-0a51-49d6-88f9-f1b0934d4b72 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:58.750990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:58.752301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:58.752751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:58.754109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] PATH_INFO: `/v3/users/7765483068ff4758ad89371e5ba38df6` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:58.757297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7765483068ff4758ad89371e5ba38df6)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:58.822153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:59.116404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7765483068ff4758ad89371e5ba38df6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:59.156453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7765483068ff4758ad89371e5ba38df6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:59.223918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7765483068ff4758ad89371e5ba38df6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:59.250123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7765483068ff4758ad89371e5ba38df6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:59.250866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7765483068ff4758ad89371e5ba38df6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:20:59.262834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1049/2095] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:20:58 2022] DELETE /identity/v3/users/7765483068ff4758ad89371e5ba38df6 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:20:59.267628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:59.268603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:59.269104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:59.343323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:20:59.351568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:59.525059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1047/2096] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:20:59.535063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:20:59.536988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:20:59.697032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5ee9-190a-4e6c-b169-859f3304a2b9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:20:59.701351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:20:59.701627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:20:59.702277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:20:59.702277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:20:59.715030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:20:59.742886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74e88-aeee-4264-b11f-6bcbf33a59eb service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:20:59.753643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1050/2097] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:21:00.685659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:00.687113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:00.710464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17932234-d67b-4a18-a86d-c4e4eaafd34a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:00.720808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:00.721620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:00.721907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:00.722213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] PATH_INFO: `/v3/projects/0cac173a057140f6b3b91b5934864915` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:00.724080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cac173a057140f6b3b91b5934864915)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:00.783983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:01.048441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cac173a057140f6b3b91b5934864915', 'request_id': 'req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:01.137850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cac173a057140f6b3b91b5934864915', 'request_id': 'req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:01.155817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cac173a057140f6b3b91b5934864915', 'request_id': 'req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:01.170879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] The token cache is being invalidate because project 0cac173a057140f6b3b91b5934864915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:21:01.171531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:01.172365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5e09a575-fcbf-4bfc-87bb-9f3cd3301db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:01.174299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1048/2098] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:21:00 2022] DELETE /identity/v3/projects/0cac173a057140f6b3b91b5934864915 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:21:01.179186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:01.179700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:01.180127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:01.212614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:01.214077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:01.375571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1051/2099] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:01.377345 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:01.377653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:01.377962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:01.425028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:01.426424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:01.441444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1049/2100] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:01.450802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:01.461451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d307c-98e8-4e5f-9c96-166e65f081da None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:01.466069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:01.469914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:01.469914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:01.469914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:01.469914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:21:01.469914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:01.494027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:01.510612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1052/2101] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:21:01.515061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:01.526713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f742bea-6cfe-4545-86b6-4923a4b8616b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:01.531408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:01.537204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:01.537204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:01.537204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:01.537204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:01.562235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:01.726082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1050/2102] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:21:01 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:21:01.730239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:01.752961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408196-4cf9-42d9-ae88-526f4144af21 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:01.857676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:01.858565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:01.858969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:01.859480 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:01.860265 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:01.889308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:01.979681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1053/2103] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:21:01 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:01.980898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:01.995252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb729f-263e-4e2d-a16d-2edeebd7afc9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:02.003132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:02.003738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:02.004023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:02.004297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:02.005189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:02.041950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d906-c760-49a8-a581-2c2cbaf18c68 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:02.059908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1051/2104] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:21:02.061285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:02.079400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298e2b-424c-4e00-a10a-30396b4d98bd admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:02.095426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:02.096239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:02.096552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:02.096955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] PATH_INFO: `/v3/projects/b98b391176f2477ca4b1e374c8d12641/users/af482d2941194468912f333c30e47d5f/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:02.134102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b391176f2477ca4b1e374c8d12641, user_id=af482d2941194468912f333c30e47d5f, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:02.165548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:02.254856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1054/2105] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:02 2022] PUT /identity/v3/projects/b98b391176f2477ca4b1e374c8d12641/users/af482d2941194468912f333c30e47d5f/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:02.259646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:02.260069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:02.260449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:02.289340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:02.290930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:02.384014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1052/2106] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:02.384902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:02.386699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:02.491199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cdd5-02b4-486a-938b-3b9b99c2f22e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:02.494546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:02.495155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:02.495436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:02.495715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:02.522514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:02.545319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e2dda-cee9-483b-a26c-22a2ef4d4593 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:02.563816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1055/2107] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:21:07.772600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:07.774003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:07.788152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd19f-68c4-47cd-b142-575312f21009 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:07.793654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:07.794507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:07.794791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:07.795068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] PATH_INFO: `/v3/users/02c87927accc44e1b16265ed6f012fdb` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:07.796164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c87927accc44e1b16265ed6f012fdb)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:07.823255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:08.032369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c87927accc44e1b16265ed6f012fdb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:08.132348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c87927accc44e1b16265ed6f012fdb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:08.143606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c87927accc44e1b16265ed6f012fdb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:08.204002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c87927accc44e1b16265ed6f012fdb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:08.204770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c87927accc44e1b16265ed6f012fdb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:08.226141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1053/2108] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:21:07 2022] DELETE /identity/v3/users/02c87927accc44e1b16265ed6f012fdb => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:08.235914 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46026b51-5972-4757-800c-b0644b461dfd None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:08.236514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46026b51-5972-4757-800c-b0644b461dfd None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:08.236615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46026b51-5972-4757-800c-b0644b461dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:08.279611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-46026b51-5972-4757-800c-b0644b461dfd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:08.281041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-46026b51-5972-4757-800c-b0644b461dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:08.405579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1056/2109] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:08.431188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:08.432762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:08.608621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdef1-febf-4756-8570-e1f37571f7bf admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:08.615965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:08.617144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:08.617735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:08.618439 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:08.632148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:08.701515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f9a0f-c9d8-4e08-ac00-a4918a8cbad2 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:08.701515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1054/2110] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:21:10.094351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46026b51-5972-4757-800c-b0644b461dfd None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:10.097054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-46026b51-5972-4757-800c-b0644b461dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:10.164809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46026b51-5972-4757-800c-b0644b461dfd None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:10.186793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:10.192148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:10.192441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:10.192715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] PATH_INFO: `/v3/projects/43042ad2ff7f4858b375b74b2a328a73` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:10.200824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43042ad2ff7f4858b375b74b2a328a73)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:10.294819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:10.527263 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43042ad2ff7f4858b375b74b2a328a73', 'request_id': 'req-60092695-135a-471a-9d26-5947602087a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:10.541770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43042ad2ff7f4858b375b74b2a328a73', 'request_id': 'req-60092695-135a-471a-9d26-5947602087a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:10.548449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43042ad2ff7f4858b375b74b2a328a73', 'request_id': 'req-60092695-135a-471a-9d26-5947602087a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:10.664019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] The token cache is being invalidate because project 43042ad2ff7f4858b375b74b2a328a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:21:10.667017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:10.667689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-60092695-135a-471a-9d26-5947602087a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:10.673562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1057/2111] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:21:10 2022] DELETE /identity/v3/projects/43042ad2ff7f4858b375b74b2a328a73 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:10.678761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:10.679277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:10.679366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:10.743075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:10.744285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:10.934836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1055/2112] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:10.943341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:10.943727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:10.944105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:11.335959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:11.335959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:11.373257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1058/2113] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:11.377495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:11.389738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949bd01-000e-4b64-ad10-00b9449538a6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:11.407145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:11.411329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:11.421541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:11.421541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:11.421541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:21:11.421541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:11.497438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:11.533845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1056/2114] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:21:11.534623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:11.556161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e01f-d2de-4aa6-9cad-abc4632dc790 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:11.564251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:11.565304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:11.565802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:11.566405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:11.568861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:11.616285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:11.781695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1059/2115] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:21:11 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:11.785779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:11.800907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b0a2-2af0-495d-a11d-50cda6051d95 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:11.996449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:11.999068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:12.002821 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:12.003357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:12.005787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:12.107748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:12.265618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1057/2116] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:21:11 2022] POST /identity/v3/users => generated 288 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:12.270800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:12.302328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73432051-4bbe-48a8-a129-a5ee7ac9556e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:12.321623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:12.323145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:12.323611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:12.324186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:12.325102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:12.414301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae6b97-d06a-4b4c-ae29-4f1081c8ba52 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:12.450268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1060/2117] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:21:12.455270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:12.490485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315ee5-1aeb-486b-b1aa-e6bdde5cc860 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:12.506329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:12.508616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:12.509127 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:12.509705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] PATH_INFO: `/v3/projects/df2de5f625244e88bc926c0cce9c3bdc/users/d6cce0a181244f3bb97bc90b1f4229cf/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:12.578734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2de5f625244e88bc926c0cce9c3bdc, user_id=d6cce0a181244f3bb97bc90b1f4229cf, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:12.642594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:12.715979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1058/2118] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:12 2022] PUT /identity/v3/projects/df2de5f625244e88bc926c0cce9c3bdc/users/d6cce0a181244f3bb97bc90b1f4229cf/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:12.727881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb596b-9324-438d-8fea-d207ba602f01 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:12.728221 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb596b-9324-438d-8fea-d207ba602f01 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:12.728447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb596b-9324-438d-8fea-d207ba602f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:12.843129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3ccb596b-9324-438d-8fea-d207ba602f01 None None] MFA Rules not processed for user `d6cce0a181244f3bb97bc90b1f4229cf`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:12.844227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3ccb596b-9324-438d-8fea-d207ba602f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:12.971837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1061/2119] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:12.983573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:12.985312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:13.164166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de82f-999a-4f7d-b64f-0a5c491228d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:13.172384 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:13.173200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:13.174280 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:13.175074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:13.206474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:13.240663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:13.254874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1059/2120] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:21:14.812862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:14.813342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:14.813462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:14.876406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] MFA Rules not processed for user `af482d2941194468912f333c30e47d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:14.880045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:15.062828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1062/2121] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:15.063946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:15.065293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:15.149768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c3857-8661-4f6f-bb65-36285b9bdae2 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:15.154380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:15.154991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.159188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.159188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.159188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:15.217332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411fb77-af79-41fa-8c36-2d9401b09e74 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:15.387619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1060/2122] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:21:15 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:15.391910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:15.405705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cb8e-e05b-4c19-a1ab-b7316d1a9362 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:15.539439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:15.540362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.540656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.541080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.541777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:15.595450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:15.644794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a8527-acf2-47cc-94dd-45437eeb75d7 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.646060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a8527-acf2-47cc-94dd-45437eeb75d7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.646599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a8527-acf2-47cc-94dd-45437eeb75d7 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.648855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1061/2123] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 10:21:15.654379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.654829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.655216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.693177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:15.695172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:15.719445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1063/2124] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:21:15 2022] POST /identity/v3/users => generated 295 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:21:15.724757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:15.749673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff019e2-a271-47da-811e-2285b6da9a8b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:15.761406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:15.763998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.764360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.765020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.765699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:15.783846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1062/2125] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:21:15.798617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:15.802741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:15.803142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:15.822756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1064/2126] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:21:15.827574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:15.841871 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7c2b0-d2fa-48bc-aba0-588fe5128137 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:15.890262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010fce-ca80-47aa-b9b6-4d10fb8a23f4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:15.890262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:15.890529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:15.890651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.890651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.890809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:15.890902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] PATH_INFO: `/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.890995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:15.890995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:15.890995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:15.907670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d4a716ec9b4aec99add5bd5f50ec8a, user_id=a7607ecf6d44409095d70255534f4b9a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:15.912085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:15.930155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1063/2127] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:21:15.936887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:16.395302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1065/2128] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:15 2022] PUT /identity/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:16.399480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:16.410201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac0045-92a6-4009-ba5b-6ce2a56d24cd service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:16.491485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:16.492111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:16.492404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:16.492689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:16.493402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:16.519552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:16.530946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1064/2129] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:21:16.542601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:16.553951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9919-cce6-4c66-9ef1-185be9cb23e9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:16.558469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:16.559303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:16.559776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:16.560054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] PATH_INFO: `/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:16.562130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d4a716ec9b4aec99add5bd5f50ec8a, user_id=a7607ecf6d44409095d70255534f4b9a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:16.605138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:16.626954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:16.633111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1066/2130] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:16 2022] PUT /identity/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:16.640890 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b67e7-5f8d-46e7-b36a-8c15289f5af4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:16.730729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:16.731668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:16.732099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:16.732498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:16.733885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:16.765525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19113-7e45-429e-8042-56d20d4c820a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:16.778843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1065/2131] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:21:16.783278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:16.795634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d75ac7-cfd8-49c1-8f84-9345f8bd7af1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:16.800282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:16.801279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:16.802097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:16.802382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] PATH_INFO: `/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:16.804321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d4a716ec9b4aec99add5bd5f50ec8a, user_id=a7607ecf6d44409095d70255534f4b9a, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:16.833986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150e898-371e-453e-b1d7-64bf38f99a5e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:17.197856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1067/2132] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:16 2022] PUT /identity/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a/users/a7607ecf6d44409095d70255534f4b9a/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:21:19.776422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:19.776876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:19.777044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:19.800179 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] MFA Rules not processed for user `c59b5476fb4a4c4b9ddd8f6ad6aee529`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:19.801387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:19.883895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1066/2133] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:22.251905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709072b-1e5d-423f-b187-f90d75b5f42a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:22.251905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709072b-1e5d-423f-b187-f90d75b5f42a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:22.251905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709072b-1e5d-423f-b187-f90d75b5f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:22.281969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4709072b-1e5d-423f-b187-f90d75b5f42a None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:22.293354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4709072b-1e5d-423f-b187-f90d75b5f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:22.387377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1068/2134] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:22.401459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:22.403444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:22.575952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c7bbd-63a8-4016-82e2-4bbf1d4c3059 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:22.590734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:22.591592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:22.592059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:22.592498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:22.617783 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:22.650777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:22.668161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1067/2135] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:21:27.606942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3506b4-3af0-4556-bbf4-9c86bbb4a68f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:27.607951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3506b4-3af0-4556-bbf4-9c86bbb4a68f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:27.608411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3506b4-3af0-4556-bbf4-9c86bbb4a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:27.669362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-cb3506b4-3af0-4556-bbf4-9c86bbb4a68f None None] MFA Rules not processed for user `a7607ecf6d44409095d70255534f4b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:27.672258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cb3506b4-3af0-4556-bbf4-9c86bbb4a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:27.792305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1069/2136] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:27.808841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:27.811028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:28.000512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c71b0-98a3-4c99-ab23-c3d099720e83 service swift] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:28.041455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:28.042315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:28.042775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:28.043222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:28.143484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:28.176768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:28.189551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1068/2137] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:27 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:21:33.474617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f643-bdc4-4cea-aab1-d048f0609dda None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:33.475183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f643-bdc4-4cea-aab1-d048f0609dda None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:33.475183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648f643-bdc4-4cea-aab1-d048f0609dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:33.503545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a648f643-bdc4-4cea-aab1-d048f0609dda None None] MFA Rules not processed for user `1e48bd3c72e54acf960df8ef4513f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:33.504990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a648f643-bdc4-4cea-aab1-d048f0609dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:33.572245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1070/2138] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:34.116067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:34.221202 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416cab3-7df6-4494-aacd-63cbb8e87904 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:34.226932 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:34.227833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:34.228212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:34.228531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] PATH_INFO: `/v3/users/d6cce0a181244f3bb97bc90b1f4229cf` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:34.229717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cce0a181244f3bb97bc90b1f4229cf)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:34.256743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:34.482960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cce0a181244f3bb97bc90b1f4229cf'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:34.581259 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cce0a181244f3bb97bc90b1f4229cf'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:34.591053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cce0a181244f3bb97bc90b1f4229cf'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:34.611742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cce0a181244f3bb97bc90b1f4229cf'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:34.612688 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cce0a181244f3bb97bc90b1f4229cf'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:34.628593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1069/2139] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:21:34 2022] DELETE /identity/v3/users/d6cce0a181244f3bb97bc90b1f4229cf => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:34.633705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:34.638412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:34.638412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:34.694935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:34.696222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:34.867500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1071/2140] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:34.879779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:34.882526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:35.139920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d79d-ad3e-4d1b-85d5-c4b386746954 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:35.156548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:35.158317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:35.159842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:35.162087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:35.189316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:35.324149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d2dfa-975c-4930-a78e-afd6aba28033 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:35.345600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1070/2141] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:21:35.999071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:36.005431 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:36.023029 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5a4e3-1584-48dc-996b-a26d1992b2e6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:36.059733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:36.062254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:36.064224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:36.064544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] PATH_INFO: `/v3/projects/df2de5f625244e88bc926c0cce9c3bdc` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:36.067785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2de5f625244e88bc926c0cce9c3bdc)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:36.100330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:36.247090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2de5f625244e88bc926c0cce9c3bdc', 'request_id': 'req-abb6c44e-e35c-477b-a532-ae0aaa3015cf'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:36.276025 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2de5f625244e88bc926c0cce9c3bdc', 'request_id': 'req-abb6c44e-e35c-477b-a532-ae0aaa3015cf'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:36.288458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2de5f625244e88bc926c0cce9c3bdc', 'request_id': 'req-abb6c44e-e35c-477b-a532-ae0aaa3015cf'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:36.398929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] The token cache is being invalidate because project df2de5f625244e88bc926c0cce9c3bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:21:36.399437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:36.400370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-abb6c44e-e35c-477b-a532-ae0aaa3015cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:21:36.402164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1072/2142] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:21:35 2022] DELETE /identity/v3/projects/df2de5f625244e88bc926c0cce9c3bdc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:21:36.407356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:36.407921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:36.408004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:36.451391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:36.453298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:36.583616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1071/2143] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:36.594959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:36.594959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:36.594959 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:36.632423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:36.633753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:36.649456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1073/2144] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:36.653996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:36.665109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094d804-315d-44eb-8a13-866c89b98af5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:36.671035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:36.672029 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:36.672543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:36.673085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:36.674272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:21:36.674787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:36.711634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:36.726885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1072/2145] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:21:36.730866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:36.740853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a025c3-fed4-4681-8c91-9c85fc9aeb09 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:36.746018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:36.746863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:36.747368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:36.747917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:36.748739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:36.782344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:36.928308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1074/2146] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:21:36 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:36.932363 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:36.958617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac68a7-ae6a-48f9-8aea-64224b358e97 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:37.063529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:37.064141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.064459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.064750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.065392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:37.092758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f2493-a168-403e-ad3e-2571d314d6cc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:37.174094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1073/2147] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:21:36 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:21:37.180859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:37.189067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.189396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.189647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.192477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a920-4eb0-4426-afa9-caed26f8f518 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:37.197515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:37.198590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.198881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.199165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.199962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:37.236003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:37.241039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:37.242242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:37.251161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1075/2148] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:21:37.255730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:37.266542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838897a-9b60-40fb-951a-d29fae38f1ee admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:37.277870 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:37.279141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.279595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.280063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] PATH_INFO: `/v3/projects/b4e869423a4f4148a912a29a363943d6/users/ff6e5382dc1a4461a92a21fde752b1c5/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.305395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e869423a4f4148a912a29a363943d6, user_id=ff6e5382dc1a4461a92a21fde752b1c5, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:37.324465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1074/2149] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:37.358074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9c705-85ef-4efd-9d87-697396b32ae1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:37.380222 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:37.380848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:37.479573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1076/2150] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:21:37 2022] PUT /identity/v3/projects/b4e869423a4f4148a912a29a363943d6/users/ff6e5382dc1a4461a92a21fde752b1c5/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:21:37.481702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.482032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.482323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.549873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bff0c-8de8-4498-8b35-370fce3adf63 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:37.602819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] MFA Rules not processed for user `ff6e5382dc1a4461a92a21fde752b1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:21:37.604048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:37.655776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:37.656534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:37.656794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:37.657009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:37.795409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1077/2151] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:21:37.806213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:21:37.807381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:37.807541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:21:37.892450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d838b-831a-4cc7-9cd3-e8f17734c23c service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:37.918160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1075/2152] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:21:38.015244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811041d-ceca-4683-81a5-bdc5dd712214 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:21:38.020945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:21:38.021549 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:21:38.021835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:21:38.022159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:21:38.032571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:21:38.089652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7948d0-8183-4384-8435-7d8dce80ddb4 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:21:38.113013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1078/2153] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:22:00.027427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:00.028404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:00.028726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:00.055486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] MFA Rules not processed for user `af482d2941194468912f333c30e47d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:22:00.056642 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:00.124197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1076/2154] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:22:00 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:22:04.333410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:04.333410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:04.334163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:04.360301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:22:04.361734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:04.370655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1079/2155] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:22:04 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:22:04.382473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:04.396699 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c767b9f-84a4-4593-869c-e3f000472036 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:04.401533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:04.402427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:04.402787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:04.403164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:04.413648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:04.439164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1227611-7b2b-42f6-ae1a-58c33575fc48 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:04.449010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1077/2156] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:22:04.629027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:04.731275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f6e22-d54f-4dd1-a2d0-95020d4bd32b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:04.735751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:04.736558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:04.736845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:04.737126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] PATH_INFO: `/v3/users/ff6e5382dc1a4461a92a21fde752b1c5` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:04.738466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6e5382dc1a4461a92a21fde752b1c5)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:04.764544 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:04.977349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6e5382dc1a4461a92a21fde752b1c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:04.985323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6e5382dc1a4461a92a21fde752b1c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:05.050807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6e5382dc1a4461a92a21fde752b1c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:05.067699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6e5382dc1a4461a92a21fde752b1c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:05.070728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6e5382dc1a4461a92a21fde752b1c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:05.085623 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1080/2157] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:22:04 2022] DELETE /identity/v3/users/ff6e5382dc1a4461a92a21fde752b1c5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:22:05.090386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:05.090709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:05.090988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:05.118377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:22:05.119863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:05.246422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1078/2158] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:22:05.257899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:05.259488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:05.361777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a13cd-9cdb-4bbd-b2f1-6113428da3a9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:05.368156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:05.369060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:05.369638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:05.369946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:05.383207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:05.414882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:05.438579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1081/2159] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:22:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:22:06.429295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:06.434618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:06.486287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee383e-5986-4ce6-9e08-09f141cbf101 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:06.495725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:06.496529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:06.496817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:06.497100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] PATH_INFO: `/v3/projects/b4e869423a4f4148a912a29a363943d6` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:06.500946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e869423a4f4148a912a29a363943d6)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:06.556298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:06.682529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e869423a4f4148a912a29a363943d6', 'request_id': 'req-f7efd966-eef4-44ec-b52e-d286332be0a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:06.787576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e869423a4f4148a912a29a363943d6', 'request_id': 'req-f7efd966-eef4-44ec-b52e-d286332be0a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:06.791348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e869423a4f4148a912a29a363943d6', 'request_id': 'req-f7efd966-eef4-44ec-b52e-d286332be0a2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:06.801544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] The token cache is being invalidate because project b4e869423a4f4148a912a29a363943d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:22:06.801834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:06.802487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:22:06.804032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1079/2160] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:22:06 2022] DELETE /identity/v3/projects/b4e869423a4f4148a912a29a363943d6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:22:31.630447 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:31.632612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:31.651168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f630a-a63c-4cb5-be02-b4e34cf78fa9 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:31.723865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:31.724460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:31.724748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:31.725064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:31.726791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:31.811690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:31.838994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:31.849171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1082/2161] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:22:32.385542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:32.386964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:32.399693 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd966-eef4-44ec-b52e-d286332be0a2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:32.405011 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:32.405603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:32.405893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:32.406262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:32.408068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:32.487490 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:32.514238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7236e7d-e100-46e7-b78d-9042fa87720f service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:32.524176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1080/2162] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:22:32 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:22:52.800991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:52.802588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:52.814010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910f61-72c5-4090-8651-afc6476bb68f service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:52.817334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:52.817910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:52.818222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:52.818498 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:52.820343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:52.901798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:52.927536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:52.939766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1083/2163] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:22:53.215031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:53.215499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:53.215601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:53.237258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] MFA Rules not processed for user `00df2776f7024acc888a4c9b2e1cc891`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:22:53.238421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:53.298904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1081/2164] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:22:53 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:22:53.360844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:22:53.362123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:53.424851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda3ac4-32a5-474c-a3f1-00c09745f535 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:22:53.428178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:22:53.428750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:22:53.429035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:22:53.429313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:22:53.431654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:22:53.443759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:22:53.468491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:22:53.479109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1084/2165] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:22:53 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:23:09.717427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:09.730003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3001fd-4876-441c-8999-b344a4fb1389 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:09.735155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:09.735867 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:09.736211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:09.736495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:09.738155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:09.748958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:09.774655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:09.784164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1082/2166] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:09 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:10.880908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:10.882330 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:10.953158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bc32d-4735-4917-8c05-56c10b72be3d service glance] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:10.956963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:10.957587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:10.957875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:10.958200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:10.959801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:11.033296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:11.044803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:11.063399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:11.063703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49258947-d47f-49d8-99cf-c2e242c219ee service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:11.069062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:11.069767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:11.070494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:11.071436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:11.074041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1085/2167] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:11.082927 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:11.112038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:11.124346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1083/2168] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:11 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:23:13.407774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:13.417323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438897-3f3b-4bb0-94fb-d862643f0016 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:13.420714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:13.421298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:13.421587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:13.421868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:13.423551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:13.432836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:13.457426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b7865-0a4a-4b72-a5d1-49f327f75033 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:13.466821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1086/2169] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:15.588968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:15.599586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171050a-6aee-43f3-bb7d-58999efcbb00 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:15.605764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:15.606448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:15.606741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:15.607027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:15.608690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:15.685870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:15.712211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:15.722910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1084/2170] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:15 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:17.609800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:17.611528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:17.611977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:17.652900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] MFA Rules not processed for user `16774d5cebcc40d8aea59afa90926050`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:23:17.654282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:17.661103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1087/2171] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:23:18.123079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:18.126081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:18.221692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b646ae-0ec3-4acf-bd83-ed4857c2a80d service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:18.228130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:18.229005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:18.229301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:18.229584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] PATH_INFO: `/v3/users/1e48bd3c72e54acf960df8ef4513f81f` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:18.230729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e48bd3c72e54acf960df8ef4513f81f)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:18.256956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:18.443579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e48bd3c72e54acf960df8ef4513f81f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:18.530321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e48bd3c72e54acf960df8ef4513f81f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:18.541963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e48bd3c72e54acf960df8ef4513f81f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:18.567884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e48bd3c72e54acf960df8ef4513f81f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:18.570150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a64e10e2-24b2-4866-9d66-88b5f040a158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e48bd3c72e54acf960df8ef4513f81f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:18.578427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1085/2172] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:23:18 2022] DELETE /identity/v3/users/1e48bd3c72e54acf960df8ef4513f81f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:23:18.933989 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:18.944967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b951-8418-472e-aa7b-53c51cb2938f None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:19.013340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:19.014166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:19.014450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:19.014722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] PATH_INFO: `/v3/projects/89ed7903d80246599aa18eff8de20d8e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:19.015866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ed7903d80246599aa18eff8de20d8e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:19.042552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:19.149146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ed7903d80246599aa18eff8de20d8e', 'request_id': 'req-0df99923-c5cb-4626-b555-8bc63bdcdd7a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:19.169677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ed7903d80246599aa18eff8de20d8e', 'request_id': 'req-0df99923-c5cb-4626-b555-8bc63bdcdd7a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:19.175391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ed7903d80246599aa18eff8de20d8e', 'request_id': 'req-0df99923-c5cb-4626-b555-8bc63bdcdd7a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:19.243427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] The token cache is being invalidate because project 89ed7903d80246599aa18eff8de20d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:23:19.244212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:19.245296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:23:19.246817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1088/2173] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:23:18 2022] DELETE /identity/v3/projects/89ed7903d80246599aa18eff8de20d8e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:23:24.347062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:24.347599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:24.347689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:24.372017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] MFA Rules not processed for user `279b268212d54d95b10267e7658722df`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:23:24.374349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:24.443111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1086/2174] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:23:25.077702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:25.079092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:25.145252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df99923-c5cb-4626-b555-8bc63bdcdd7a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:25.148604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:25.149189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:25.149655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:25.150484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:25.154887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:25.162457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:25.188043 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:25.196903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1089/2175] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:25.742679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:25.745352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:25.824346 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c135c9-8c5e-455b-b58c-601c662c0200 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:25.829046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:25.829635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:25.830165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:25.830409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:25.834623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:25.845764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:25.872220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:25.881392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1087/2176] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:25.991658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:25.993032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:26.006466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a71354-7502-4011-aecc-fa3ebc72246b service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:26.011351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:26.011929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:26.012218 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:26.012499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:26.014159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:26.025299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:26.050515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:26.060023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1090/2177] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:36.283141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:36.284445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:36.364843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9154-cefe-4ee0-9c08-6b5b769da862 service placement] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:36.370141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:36.370726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:36.371015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:36.371302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:36.372944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:36.387053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:36.413142 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:36.424405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1088/2178] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:36 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:23:41.573667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:23:41.585527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15b896-2c2b-423b-a13f-e0c5a087e16b service placement] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:23:41.590973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:23:41.591558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:23:41.591846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:23:41.592130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:23:41.593782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:23:41.605747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:23:41.631560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ecb4-2180-409e-a09f-c2c89d428313 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:23:41.642640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1091/2179] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:23:41 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:24:32.312244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:24:32.314638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:32.353792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60cb5-26eb-4393-9df7-ba68909c2c81 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:24:32.369568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:24:32.370519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:32.371034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:32.372382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:32.374422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:32.397884 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:24:32.437182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a860516-0dcc-4cc7-bc55-c433ac01afda service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:24:32.455738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1089/2180] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:24:32.517630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:32.518520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:32.519015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:32.550482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] MFA Rules not processed for user `00df2776f7024acc888a4c9b2e1cc891`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:24:32.552100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:32.662340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1092/2181] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:24:42.091011 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:42.091621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:42.091853 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:42.119323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:24:42.120722 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:42.205670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1090/2182] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:24:42 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:24:42.477040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:24:42.478568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:42.569605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cb1f0-092d-45b2-8bf6-a061e2b98c92 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:24:42.576579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:24:42.577236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:42.577574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:42.577860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:42.587180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:24:42.613433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:24:42.623692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1093/2183] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:24:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:24:47.433818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:24:47.436005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:47.507766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72202c9-7b39-4684-bee7-e145955eb006 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:24:47.512556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:24:47.513161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:47.513479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:47.513765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:47.515502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:47.593358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:24:47.621027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00951568-d87b-4107-87a6-019e89e93180 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:24:47.631787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1091/2184] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:24:47.802220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:24:47.804412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:47.821215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c132e-1a99-441e-a40e-695146a7b8ca service swift] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:24:47.825907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:24:47.827310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:47.827988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:47.828433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:47.831161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:47.922395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:24:47.953188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:24:47.983658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1094/2185] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:24:56.239558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:56.240509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:56.240977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:56.271766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:24:56.274421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:24:56.289596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1092/2186] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:24:56 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:24:56.297408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:24:56.314343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566b9c9-3b05-403e-bd52-ec27058b8ebd service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:24:56.319839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:24:56.329214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:24:56.330230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:24:56.330687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:24:56.343755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:24:56.379105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:24:56.394910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1095/2187] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:25:00.387172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:00.390086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:00.412546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd8526-5c1b-4602-b223-e8a61d692e06 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:00.425859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:00.426860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:00.427148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:00.427654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] PATH_INFO: `/v3/users/16774d5cebcc40d8aea59afa90926050` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:00.429368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16774d5cebcc40d8aea59afa90926050)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:00.468540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:00.799406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16774d5cebcc40d8aea59afa90926050'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:00.933228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16774d5cebcc40d8aea59afa90926050'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:00.945973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16774d5cebcc40d8aea59afa90926050'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:00.976554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16774d5cebcc40d8aea59afa90926050'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:00.985591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-57898cd8-173e-4768-aaa7-0de8bd62a468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16774d5cebcc40d8aea59afa90926050'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:01.020294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1093/2188] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:00 2022] DELETE /identity/v3/users/16774d5cebcc40d8aea59afa90926050 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:02.612865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:02.627426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1edcb-64bd-4500-8e26-83a88a412bf7 service swift] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:02.692061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a01b-2470-40b3-9327-76cb96ce9459 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:02.702081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a01b-2470-40b3-9327-76cb96ce9459 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:02.702081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a01b-2470-40b3-9327-76cb96ce9459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:02.734433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c454a01b-2470-40b3-9327-76cb96ce9459 None None] MFA Rules not processed for user `af482d2941194468912f333c30e47d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:02.737405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c454a01b-2470-40b3-9327-76cb96ce9459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:02.754762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:02.756357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:02.757021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:02.757521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] PATH_INFO: `/v3/projects/6c26929cdc2e419397fb84381a87eae9` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:02.760110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c26929cdc2e419397fb84381a87eae9)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:02.799093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:02.824432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1094/2189] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:25:03.218163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c26929cdc2e419397fb84381a87eae9', 'request_id': 'req-7ec1502b-7626-4323-b57f-92164c0d6a9f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:03.234475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c26929cdc2e419397fb84381a87eae9', 'request_id': 'req-7ec1502b-7626-4323-b57f-92164c0d6a9f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:03.240877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c26929cdc2e419397fb84381a87eae9', 'request_id': 'req-7ec1502b-7626-4323-b57f-92164c0d6a9f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:03.315329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] The token cache is being invalidate because project 6c26929cdc2e419397fb84381a87eae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:03.315468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:03.316209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7ec1502b-7626-4323-b57f-92164c0d6a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:03.322156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1096/2190] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:02 2022] DELETE /identity/v3/projects/6c26929cdc2e419397fb84381a87eae9 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:03.323977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:03.324276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:03.324561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:03.373083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:03.374273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:03.563211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1095/2191] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:03.565055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:03.565853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:03.566598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:03.620127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:03.621303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:03.649011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1097/2192] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:03.650954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:03.661082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e27b-aa03-4e50-a239-457c27f02d0d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:03.673913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:03.675584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:03.687995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:03.696268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:03.696268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:03.696268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:03.696268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:25:03.696268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:03.765115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a151d-06f6-4201-95ec-f5bd2013a2e2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:03.768481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:03.768481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:03.768807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:03.769064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:03.770796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:03.789663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:03.793300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:03.820003 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:03.831361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1096/2193] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:25:03.834291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:03.834518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1098/2194] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:25:03.867299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc960b9-cd46-49aa-9f7c-e49ae6360ed8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:03.880153 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:03.881561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:03.882105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:03.885228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:03.886275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:03.963707 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:04.162627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1097/2195] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:03 2022] POST /identity/v3/projects => generated 357 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:04.163319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:04.183824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2631135-3aa0-4683-80fd-3f6187bcc161 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:04.294753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:04.295785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:04.296382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:04.297302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:04.298327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:04.329409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:04.516850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:04.526488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1099/2196] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:04 2022] POST /identity/v3/users => generated 279 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:04.541340 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8aa01-c9a1-447b-b6d3-04c9ae754029 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:04.553858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:04.555391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:04.557835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:04.558527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:04.560545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:04.626829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf5052-c3f4-45a2-a0ca-72128a9eb2e0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:04.669348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:04.681782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1098/2197] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:04.684203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a32b-4136-4254-8d6a-cdf08e9d2be2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:04.695732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:04.697908 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:04.698944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:04.701748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] PATH_INFO: `/v3/projects/307ff64078c2443cae52a7b168794801/users/9d9785607ee343318f245c595f97d9a9/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:04.733323 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307ff64078c2443cae52a7b168794801, user_id=9d9785607ee343318f245c595f97d9a9, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:04.801711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:04.988002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:04.988808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:04.989102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:05.002573 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1100/2198] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:04 2022] PUT /identity/v3/projects/307ff64078c2443cae52a7b168794801/users/9d9785607ee343318f245c595f97d9a9/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:05.056780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] MFA Rules not processed for user `9d9785607ee343318f245c595f97d9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:05.058129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:05.179421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:05.191520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1099/2199] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:04 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:05.371900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c65f4-36ed-441e-b9cf-55c6b03f3170 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:05.383743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:05.387092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:05.387092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:05.387092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:05.388239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:05.424955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:05.579681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1101/2200] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:05 2022] POST /identity/v3/projects => generated 357 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:25:05.584289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:05.610385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6f3d6-a38b-4b6c-b46a-9a17edbbeef9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:05.786276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:05.789846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:05.789846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:05.789846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:05.789846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:05.827730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:05.986523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1100/2201] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:05 2022] POST /identity/v3/users => generated 285 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:05.991002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.010072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cb2a-85f5-4b08-98ff-aa311f744db5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.021157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.021844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.023603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.023969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.029634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.096340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:06.116578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1102/2202] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:06.122247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.133005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d52193-14ea-4b38-8146-6985aa40ccd7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.153124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.154001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.154309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.154574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] PATH_INFO: `/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.205111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5030a0b57a4343ae0db874266c0c2b, user_id=8064421a990a445fb1740c6383d222e0, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.251407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b408d7-4a4d-45d7-8ae5-4451a3281370 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:06.369470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1101/2203] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:06 2022] PUT /identity/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:25:06.373666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.388601 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c7671-260c-49e4-97b9-7b72bc08c623 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.498868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.500215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.500215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.500215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.500724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.527298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:06.534621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.535247 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.537430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.550114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1103/2204] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:25:06.551948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.565467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7165aa-ca02-4670-a8a1-31cef49e1b5b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.567366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] MFA Rules not processed for user `afef28a167e84f26a8bd5ef64a124ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:06.568485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:06.571349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.578893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.578893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.578893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] PATH_INFO: `/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.578893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5030a0b57a4343ae0db874266c0c2b, user_id=8064421a990a445fb1740c6383d222e0, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.607689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:06.622814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1104/2205] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:06 2022] PUT /identity/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:06.623978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.675111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1102/2206] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:25:06.810416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9fce-6d14-4b55-8969-9ab9d06a365d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.817168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.817587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.817878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.818218 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.818940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.857596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283dd4-46c9-4d44-bca5-98c2f565f2bb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:06.873886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1105/2207] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:06.874846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:06.887169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0afa6-1e27-4d8f-95b2-8b537fb1a2d7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:06.894234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:06.895463 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:06.895818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:06.896187 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] PATH_INFO: `/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:06.904728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5030a0b57a4343ae0db874266c0c2b, user_id=8064421a990a445fb1740c6383d222e0, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:06.933317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:07.057103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1103/2208] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:06 2022] PUT /identity/v3/projects/ad5030a0b57a4343ae0db874266c0c2b/users/8064421a990a445fb1740c6383d222e0/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:25:07.060394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:07.061244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:07.062228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:07.134348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] MFA Rules not processed for user `8064421a990a445fb1740c6383d222e0`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:07.135676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:07.324838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1106/2209] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3731 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:07.331530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:07.334423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:07.432883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b3070-90e9-4c01-87ea-3f4c6d463af3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:07.440241 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:07.441215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:07.441718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:07.442732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:07.455391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:07.483729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:07.497369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1104/2210] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3731 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:07.927983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:07.940863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03fb36-2fde-43fd-aa1c-ef406e894017 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:07.949176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:07.950134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:07.950655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:07.951146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:08.134839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:08.172650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:08.187033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1107/2211] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:10.138111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:10.140240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:10.234837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096b2b6-e744-4b8b-8a59-85968679debf service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:10.247047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:10.247944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:10.248228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:10.248511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] PATH_INFO: `/v3/users/c59b5476fb4a4c4b9ddd8f6ad6aee529` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:10.249757 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59b5476fb4a4c4b9ddd8f6ad6aee529)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:10.286735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:10.598671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59b5476fb4a4c4b9ddd8f6ad6aee529'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:10.721841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59b5476fb4a4c4b9ddd8f6ad6aee529'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:10.744789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59b5476fb4a4c4b9ddd8f6ad6aee529'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:10.782829 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59b5476fb4a4c4b9ddd8f6ad6aee529'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:10.783677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59b5476fb4a4c4b9ddd8f6ad6aee529'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:10.795160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1105/2212] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:10 2022] DELETE /identity/v3/users/c59b5476fb4a4c4b9ddd8f6ad6aee529 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:11.514609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:11.538423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e249c-ee13-405e-a9e5-124c0aeca506 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:11.694293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:11.695577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:11.696034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:11.697119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] PATH_INFO: `/v3/projects/a5cf8fe4306446d985fb4a66132ccf62` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:11.698610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cf8fe4306446d985fb4a66132ccf62)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:11.726424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:11.886588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cf8fe4306446d985fb4a66132ccf62', 'request_id': 'req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:11.915028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cf8fe4306446d985fb4a66132ccf62', 'request_id': 'req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:11.923226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cf8fe4306446d985fb4a66132ccf62', 'request_id': 'req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.059808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] The token cache is being invalidate because project a5cf8fe4306446d985fb4a66132ccf62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:12.060080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.061116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.062939 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1108/2213] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:11 2022] DELETE /identity/v3/projects/a5cf8fe4306446d985fb4a66132ccf62 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:12.067115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:12.069609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:12.090150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60882827-1359-425b-aeb5-dc70eea8ef8d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:12.209125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:12.211347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:12.211347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:12.211347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] PATH_INFO: `/v3/users/99773ef57b8049f7aec7e273dd995b00` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:12.212444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99773ef57b8049f7aec7e273dd995b00)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:12.253129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:12.542474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99773ef57b8049f7aec7e273dd995b00'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.691387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99773ef57b8049f7aec7e273dd995b00'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.702434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99773ef57b8049f7aec7e273dd995b00'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.736571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99773ef57b8049f7aec7e273dd995b00'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.738307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-39415785-27d8-43c7-8108-980c1fd21497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99773ef57b8049f7aec7e273dd995b00'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:12.753791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1106/2214] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:12 2022] DELETE /identity/v3/users/99773ef57b8049f7aec7e273dd995b00 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:13.288260 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:13.292191 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:13.338976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbcc8d-fba9-4fc4-affe-e68574a1bb40 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:13.472385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:13.473556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:13.474985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:13.485100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] PATH_INFO: `/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:13.486714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267c7813a87c4ef3a93cd6bcd742dca0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:13.540292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:13.705770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267c7813a87c4ef3a93cd6bcd742dca0', 'request_id': 'req-9926f188-23b0-442f-b484-020d5ccac289'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:13.724843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267c7813a87c4ef3a93cd6bcd742dca0', 'request_id': 'req-9926f188-23b0-442f-b484-020d5ccac289'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:13.735406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267c7813a87c4ef3a93cd6bcd742dca0', 'request_id': 'req-9926f188-23b0-442f-b484-020d5ccac289'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:13.878911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] The token cache is being invalidate because project 267c7813a87c4ef3a93cd6bcd742dca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:13.879593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:13.881234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9926f188-23b0-442f-b484-020d5ccac289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:13.884147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1109/2215] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:13 2022] DELETE /identity/v3/projects/267c7813a87c4ef3a93cd6bcd742dca0 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:25.831196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:25.831772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:25.831772 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] PATH_INFO: `/` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:25.833583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1107/2216] 10.222.0.11 () {54 vars in 921 bytes} [Wed Apr 6 10:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 10:25:25.841832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c565c2-86c2-4c07-93f5-718261b887fa None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:25.846437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c565c2-86c2-4c07-93f5-718261b887fa None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:25.846437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c565c2-86c2-4c07-93f5-718261b887fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:25.879233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-88c565c2-86c2-4c07-93f5-718261b887fa None None] MFA Rules not processed for user `2c0d2de121404193950d51be23d2f57a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:25.881123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-88c565c2-86c2-4c07-93f5-718261b887fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:26.018475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1110/2217] 10.222.0.11 () {58 vars in 1018 bytes} [Wed Apr 6 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:26.019021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:26.019021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:26.033487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfb8d5-7950-4cf3-8031-f42ee30ac566 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:26.037833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:26.038752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:26.039405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:26.040188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:26.051907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:26.084746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:26.095425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1108/2218] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:30.561391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:30.561866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:30.562010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:30.587161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:30.588249 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:30.664992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1111/2219] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:30.678248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:30.680893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:30.780172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff437-de15-40e3-a505-7adeca4609bb service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:30.786656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:30.790924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:30.790924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:30.790924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:30.799809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:30.828188 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54df811-b108-4759-91d5-629cdd55f8cc service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:30.837997 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1109/2220] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:25:32.835497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:32.838612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:32.955017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999807d-9407-4700-b2fd-71dbbf1b99ab None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:32.960285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:32.962432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:32.963053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:32.963509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] PATH_INFO: `/v3/users/9d9785607ee343318f245c595f97d9a9` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:32.964866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9785607ee343318f245c595f97d9a9)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:33.071413 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:33.336990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9785607ee343318f245c595f97d9a9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:33.348830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9785607ee343318f245c595f97d9a9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:33.416541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9785607ee343318f245c595f97d9a9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:33.434804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9785607ee343318f245c595f97d9a9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:33.435564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9785607ee343318f245c595f97d9a9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:33.442733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1112/2221] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:32 2022] DELETE /identity/v3/users/9d9785607ee343318f245c595f97d9a9 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:33.448993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:33.448993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:33.448993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:33.487228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:33.488483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:33.702910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1110/2222] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:33.721368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:33.723244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:33.829337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3719-2fca-42c8-8af1-3b41e81a0309 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:33.833097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:33.833844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:33.834151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:33.834428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:33.853076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:33.901701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:33.910151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1113/2223] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:34.927609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:34.930000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:34.959955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68429-99a0-45b8-bf99-f67d3c30c645 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:34.969319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:34.970548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:34.971199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:34.971959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] PATH_INFO: `/v3/projects/307ff64078c2443cae52a7b168794801` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:34.973866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=307ff64078c2443cae52a7b168794801)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:35.022692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:35.263655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307ff64078c2443cae52a7b168794801', 'request_id': 'req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.372001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307ff64078c2443cae52a7b168794801', 'request_id': 'req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.404120 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307ff64078c2443cae52a7b168794801', 'request_id': 'req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.423057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] The token cache is being invalidate because project 307ff64078c2443cae52a7b168794801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:35.423497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.424173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.425913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1111/2224] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:34 2022] DELETE /identity/v3/projects/307ff64078c2443cae52a7b168794801 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:35.431154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:35.453560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892162e-c6ee-4265-ac81-e05cda81cf12 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:35.551545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:35.553031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:35.553460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:35.554072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] PATH_INFO: `/v3/users/8064421a990a445fb1740c6383d222e0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:35.558608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8064421a990a445fb1740c6383d222e0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:35.593187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:35.848303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8064421a990a445fb1740c6383d222e0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.857767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8064421a990a445fb1740c6383d222e0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.919102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8064421a990a445fb1740c6383d222e0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.942112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8064421a990a445fb1740c6383d222e0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.943035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81d179aa-86c8-4c76-85b9-f8286b8a12fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8064421a990a445fb1740c6383d222e0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:35.966473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1114/2225] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:35 2022] DELETE /identity/v3/users/8064421a990a445fb1740c6383d222e0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:37.078014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:37.079851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:37.101138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d22a-4cd0-4274-8d0c-0a9bec7ad30d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:37.261205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:37.262157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:37.263504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:37.264662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] PATH_INFO: `/v3/projects/ad5030a0b57a4343ae0db874266c0c2b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:37.273021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5030a0b57a4343ae0db874266c0c2b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:37.328723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:37.501679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5030a0b57a4343ae0db874266c0c2b', 'request_id': 'req-62864a7c-706b-4828-8db9-7f58eae602ab'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:37.577526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5030a0b57a4343ae0db874266c0c2b', 'request_id': 'req-62864a7c-706b-4828-8db9-7f58eae602ab'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:37.591922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5030a0b57a4343ae0db874266c0c2b', 'request_id': 'req-62864a7c-706b-4828-8db9-7f58eae602ab'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:37.604006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] The token cache is being invalidate because project ad5030a0b57a4343ae0db874266c0c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:37.604299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:37.605038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-62864a7c-706b-4828-8db9-7f58eae602ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:37.614946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1112/2226] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:37 2022] DELETE /identity/v3/projects/ad5030a0b57a4343ae0db874266c0c2b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:37.616504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:37.617564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:37.617820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:37.660382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:37.662250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:37.761357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1115/2227] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:25:37.770479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:37.770684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:37.770922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:37.833350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:37.834968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:37.852711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1113/2228] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:37.862514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:37.881481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8a90-f82d-4d7f-80ca-f5e9b7e30c36 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:37.889038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:37.889759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:37.889962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:37.890252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:37.891168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:25:37.891928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:37.923448 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:37.949976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1116/2229] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:25:37.960263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:37.971769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9864ad-43a3-47c1-8a2d-72896507f967 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:37.980488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:37.981380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:37.981843 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:37.982300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:37.983885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:38.028567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:38.128746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1114/2230] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:37 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:25:38.134493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:38.156465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f331a3c-28dd-45b1-9575-95729b32fd92 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:38.246318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:38.247027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:38.247383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:38.247840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:38.248745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:38.279771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:38.391666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1117/2231] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:38 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:38.396665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:38.410673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f664714-6b67-440e-b559-f8613ab2cae1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:38.417038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:38.418896 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:38.419382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:38.420068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:38.421550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:38.464085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534553d4-238f-40a0-8f1b-c4bb91fcd30e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:38.475073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1115/2232] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:38.480126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:38.490248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a010-6fe5-4bc8-a4a9-ce83fdb498aa admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:38.495050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:38.495896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:38.496189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:38.496472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] PATH_INFO: `/v3/projects/be2c73fdd5fd45629ac1137c1546f85e/users/ad22d3ca1ff644f0a7052bf368afece2/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:38.519741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2c73fdd5fd45629ac1137c1546f85e, user_id=ad22d3ca1ff644f0a7052bf368afece2, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:38.548354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:38.622230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1118/2233] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:38 2022] PUT /identity/v3/projects/be2c73fdd5fd45629ac1137c1546f85e/users/ad22d3ca1ff644f0a7052bf368afece2/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:38.635935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:38.636541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:38.637015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:38.690750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] MFA Rules not processed for user `ad22d3ca1ff644f0a7052bf368afece2`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:38.690750 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:38.777018 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1116/2234] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:25:38.783533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:38.888058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344a87-ea0b-418b-a50e-181610fa5ac2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:38.892845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:38.893459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:38.893692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:38.894096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:38.894779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:38.921750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.021153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1119/2235] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:38 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:39.026430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.039023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe2cb-fc30-4702-9c7f-39568ecfae2f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:39.143458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:39.144478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:39.145042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:39.145474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:39.146633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:39.184993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.428522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1117/2236] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:39 2022] POST /identity/v3/users => generated 299 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:39.433762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.451839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f272722-acff-4353-ae0d-f95b24cf3237 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:39.457511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:39.458429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:39.458801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:39.459165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:39.460167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:39.500530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.515681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1120/2237] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:25:39.518556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.530134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dffb8-35d2-44b0-9aba-b37cc7962ee9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:39.534775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:39.535865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:39.536319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:39.536603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] PATH_INFO: `/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:39.559549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc5e08923e048929f7b113262732590, user_id=c72459a0b68240e88db3ddc3d9e763a2, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:39.589632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.705963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1118/2238] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:39 2022] PUT /identity/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:25:39.710899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.733437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb661916-ae7b-49a8-83d8-936904937a11 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:39.825341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:39.826261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:39.826722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:39.827247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:39.828015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:39.856076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.867550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1121/2239] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:39.872317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.883051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674cece-405b-4d6f-8dc6-4f73d81f1044 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:39.887930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:39.888917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:39.889315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:39.889705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] PATH_INFO: `/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:39.891985 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc5e08923e048929f7b113262732590, user_id=c72459a0b68240e88db3ddc3d9e763a2, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:39.919505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:39.930842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1119/2240] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:39 2022] PUT /identity/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:25:39.934855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:39.950548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67189-27c5-4018-8841-a4949e8ee421 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:40.042610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:40.043380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:40.043689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:40.043985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:40.044714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:40.075886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a89e1-8665-4951-abe9-0a0e83a3a0d7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:40.091393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1122/2241] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:40.093305 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:40.104902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840ae9e-33b3-4b0b-a9f1-6b063e4c57ea admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:40.109386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:40.110240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:40.110531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:40.110813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] PATH_INFO: `/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:40.112639 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc5e08923e048929f7b113262732590, user_id=c72459a0b68240e88db3ddc3d9e763a2, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:40.140733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:40.220897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1120/2242] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:40 2022] PUT /identity/v3/projects/9dc5e08923e048929f7b113262732590/users/c72459a0b68240e88db3ddc3d9e763a2/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:25:40.233153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:40.233639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:40.234126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:40.281271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] MFA Rules not processed for user `c72459a0b68240e88db3ddc3d9e763a2`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:40.289556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:40.365093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1123/2243] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:40.375499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:40.377180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:40.446221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1e16f-91c9-46ad-9df6-2393fd35ea28 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:40.450207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:40.450797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:40.451093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:40.451375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:40.461865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:40.487402 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d77f7-1d6c-4837-9457-f55887062989 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:40.497913 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1121/2244] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:40 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:40.568097 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:40.652037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d25a83-e0c9-47bd-9ae0-449b269f91c5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:40.657562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:40.658226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:40.658514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:40.658792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] PATH_INFO: `/v3/users/ad22d3ca1ff644f0a7052bf368afece2` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:40.659928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad22d3ca1ff644f0a7052bf368afece2)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:40.687845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:40.906326 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad22d3ca1ff644f0a7052bf368afece2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:40.914976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad22d3ca1ff644f0a7052bf368afece2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:41.021370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad22d3ca1ff644f0a7052bf368afece2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:41.034926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad22d3ca1ff644f0a7052bf368afece2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:41.035642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad22d3ca1ff644f0a7052bf368afece2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:41.042785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1124/2245] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:40 2022] DELETE /identity/v3/users/ad22d3ca1ff644f0a7052bf368afece2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:41.048027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:41.048404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:41.048771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:41.073288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:41.074513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:41.142978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1122/2246] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:41.153324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:41.154676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:41.227771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640917-7a0c-41ac-be45-a46f7ed3e674 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:41.227771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:41.227771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:41.227771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:41.228284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:41.236361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:41.262783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:41.272599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1125/2247] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:41.811212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:41.813441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:41.855863 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930e516-5976-4ec8-96f2-d3d1106ff919 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:41.861679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:41.862844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:41.864248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:41.865233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] PATH_INFO: `/v3/projects/be2c73fdd5fd45629ac1137c1546f85e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:41.867357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2c73fdd5fd45629ac1137c1546f85e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:41.906923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:42.087672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2c73fdd5fd45629ac1137c1546f85e', 'request_id': 'req-321080af-cabb-4bd9-a15e-ca03c0ada860'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.171806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2c73fdd5fd45629ac1137c1546f85e', 'request_id': 'req-321080af-cabb-4bd9-a15e-ca03c0ada860'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.184265 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2c73fdd5fd45629ac1137c1546f85e', 'request_id': 'req-321080af-cabb-4bd9-a15e-ca03c0ada860'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.201375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] The token cache is being invalidate because project be2c73fdd5fd45629ac1137c1546f85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:42.201375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.201375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.201375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1123/2248] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:41 2022] DELETE /identity/v3/projects/be2c73fdd5fd45629ac1137c1546f85e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:42.202913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:42.212851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec4df-183f-4123-ab30-0371b0701eae service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:42.287294 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:42.288168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:42.288380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:42.288681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] PATH_INFO: `/v3/users/c72459a0b68240e88db3ddc3d9e763a2` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:42.289999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72459a0b68240e88db3ddc3d9e763a2)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:42.318651 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:42.588850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72459a0b68240e88db3ddc3d9e763a2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.597786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72459a0b68240e88db3ddc3d9e763a2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.701234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72459a0b68240e88db3ddc3d9e763a2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.717264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72459a0b68240e88db3ddc3d9e763a2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.718238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f5c9fe17-ffd0-4c6f-9310-7948d8d927cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72459a0b68240e88db3ddc3d9e763a2'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:42.725031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1126/2249] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:42 2022] DELETE /identity/v3/users/c72459a0b68240e88db3ddc3d9e763a2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:43.359257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:43.370288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:43.376984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321080af-cabb-4bd9-a15e-ca03c0ada860 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:43.466911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:43.468167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:43.468696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:43.469008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] PATH_INFO: `/v3/projects/9dc5e08923e048929f7b113262732590` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:43.471243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc5e08923e048929f7b113262732590)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:43.500385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:43.607645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc5e08923e048929f7b113262732590', 'request_id': 'req-3d03da21-708c-44ba-95df-6d27c4e2ca3b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:43.730517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc5e08923e048929f7b113262732590', 'request_id': 'req-3d03da21-708c-44ba-95df-6d27c4e2ca3b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:43.745813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc5e08923e048929f7b113262732590', 'request_id': 'req-3d03da21-708c-44ba-95df-6d27c4e2ca3b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:43.757015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] The token cache is being invalidate because project 9dc5e08923e048929f7b113262732590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:25:43.758095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:43.758758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3d03da21-708c-44ba-95df-6d27c4e2ca3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:43.760450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1124/2250] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:25:43 2022] DELETE /identity/v3/projects/9dc5e08923e048929f7b113262732590 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:43.765568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:43.766120 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:43.766461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:43.790235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:43.791476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:43.864080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1127/2251] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:43.873593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:43.873904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:43.874319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:43.900640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:43.901823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:43.909660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1125/2252] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:43.914630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:43.923960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e57a2-0ac3-4a77-b3b0-716f4579ad8e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:43.928117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:43.928704 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:43.928993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:43.929843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:43.930587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:25:43.930893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:43.955575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:43.969272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1128/2253] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:25:43.976841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:43.983289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff936b6-0164-460a-bb22-d4fc754415c8 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:43.987612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:43.988197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:43.988485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:43.988773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:43.989401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:44.016170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:44.127429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1126/2254] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:43 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:44.132763 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:44.142321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48093-f438-40e3-ae65-c1b0db097645 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:44.206122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:44.206720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:44.207005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:44.207281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:44.207922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:44.234009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:44.314397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1129/2255] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:44 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:44.318709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:44.328535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc3a5-a41c-48bf-a1e8-24a3e02ce7a5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:44.332742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:44.333322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:44.333610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:44.333891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:44.334619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:44.362669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a952ede-a3f9-4283-bb5f-704798438455 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:44.373622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1127/2256] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:25:44.377815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:44.388494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ae8ba-16db-4e03-b8dc-0df07b3d6f75 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:44.392828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:44.393644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:44.393949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:44.394253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] PATH_INFO: `/v3/projects/10fc9e6aca7f476ab7597a26c2671768/users/2d833ce988784e03a22e115b0bfc8f4b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:44.415520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fc9e6aca7f476ab7597a26c2671768, user_id=2d833ce988784e03a22e115b0bfc8f4b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:44.442599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:45.509655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1130/2257] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:44 2022] PUT /identity/v3/projects/10fc9e6aca7f476ab7597a26c2671768/users/2d833ce988784e03a22e115b0bfc8f4b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:45.520974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:45.521522 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:45.521617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:45.567403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] MFA Rules not processed for user `2d833ce988784e03a22e115b0bfc8f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:45.568760 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:45.648071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1128/2258] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:45.653141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:45.728111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae04c6-c7e5-4ca8-a330-4936ee9a4274 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:45.734690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:45.735821 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:45.736397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:45.737091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:45.737502 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:45.765509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:45.889592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1131/2259] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:25:45 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:45.893857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:45.907158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755700a-1d40-4ebd-83a7-162a1ffd6ad9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:45.982032 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:45.982529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:45.982815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:45.983260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:45.983912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.013091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.113523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1129/2260] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:25:45 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:25:46.118201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.130013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243adcb-670e-4557-a878-9d0f86d9421f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.135007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.135806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.136129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.136458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.137248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.168241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.181154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1132/2261] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:46.185752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.196414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493b45-bf7c-4a31-a834-d87f31e14c9f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.200570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.201369 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.201651 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.201942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] PATH_INFO: `/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.224714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6db88a7acf94995b1471fc40c9b9fdf, user_id=88672180cbc74fb3a67a2709149a9c25, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.256753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.338133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1130/2262] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:46 2022] PUT /identity/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:46.342661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.353355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecc25e-1d03-4f46-9035-165cd3215014 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.419900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.420427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.420717 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.421000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.421701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.447801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.458587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1133/2263] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:25:46.464455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.475109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50800-58ae-4121-94bf-e5a5f84900a5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.481005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.481825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.482140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.482422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] PATH_INFO: `/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.484221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6db88a7acf94995b1471fc40c9b9fdf, user_id=88672180cbc74fb3a67a2709149a9c25, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.512588 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.537978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1131/2264] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:46 2022] PUT /identity/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:46.542006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.543496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905508e5-d84a-4478-8d39-bd021f7d73c7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.619607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.620252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.620559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.620842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.621576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.648905 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfb38-3773-4c9e-8f3b-c5a2a906e578 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.660711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1134/2265] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:25:46.665169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.678378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326600-c6ea-4def-b166-d643d855e3e6 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:46.683793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:46.684730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.685014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.685338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] PATH_INFO: `/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.687408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6db88a7acf94995b1471fc40c9b9fdf, user_id=88672180cbc74fb3a67a2709149a9c25, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:46.718044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:46.807611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1132/2266] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:25:46 2022] PUT /identity/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf/users/88672180cbc74fb3a67a2709149a9c25/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:25:46.819317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b77d9-c2c5-4290-a5f7-75f04e3a121a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:46.819672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b77d9-c2c5-4290-a5f7-75f04e3a121a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:46.820516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b77d9-c2c5-4290-a5f7-75f04e3a121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:46.862781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ff4b77d9-c2c5-4290-a5f7-75f04e3a121a None None] MFA Rules not processed for user `88672180cbc74fb3a67a2709149a9c25`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:46.864000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ff4b77d9-c2c5-4290-a5f7-75f04e3a121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:46.946606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1135/2267] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:46.956365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:46.958017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:47.022507 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661c51-5a90-40e4-8a2d-55c1b506c901 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:47.026412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:47.026980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:47.027268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:47.027549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:47.091211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:47.117404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:47.127242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1133/2268] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:46 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:47.275571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:47.275968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:47.276336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:47.305457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:25:47.307040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:47.420019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1136/2269] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:25:47.443158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:47.446174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:47.523702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e151636-3165-4eef-8c5d-eccb13a1952a service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:47.528312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:47.528894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:47.529186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:47.529503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:47.537553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:47.565965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:47.575885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1134/2270] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:25:53.274696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:53.276179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:53.288596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338411-8670-4877-ab35-956f6c2ab75a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:53.293040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:53.293631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:53.294051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:53.294347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:53.304376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:53.329429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:53.339840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1137/2271] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:54.993514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:54.994999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:55.072382 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d67067-71f5-4e83-acda-e7a6ff13daa0 service swift] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:55.077100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:55.077685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:55.078003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:55.078290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:55.080002 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:55.091674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:55.117738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:55.127820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1135/2272] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:58.908546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:58.909941 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:58.977697 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10749-e0da-475f-9842-f5d7dd9894f6 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:58.981076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:58.981859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:58.982453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:58.982947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:58.985438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:25:59.064366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:59.089113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d5e83-5e65-456b-acb9-0e81cdf89f2c service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:59.099033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1138/2273] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:25:59.654850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:25:59.665814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16c08-94cf-46d4-b6c4-2b0e520d251d service placement] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:25:59.670081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:25:59.670887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:25:59.671176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:25:59.671458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] PATH_INFO: `/v3/users/2d833ce988784e03a22e115b0bfc8f4b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:25:59.672550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d833ce988784e03a22e115b0bfc8f4b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:25:59.699056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:25:59.906256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d833ce988784e03a22e115b0bfc8f4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:59.982566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d833ce988784e03a22e115b0bfc8f4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:25:59.992350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d833ce988784e03a22e115b0bfc8f4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:00.008472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d833ce988784e03a22e115b0bfc8f4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:00.009264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d833ce988784e03a22e115b0bfc8f4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:00.017258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1136/2274] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:25:59 2022] DELETE /identity/v3/users/2d833ce988784e03a22e115b0bfc8f4b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:00.024276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:00.024872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:00.025245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:00.048836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:00.050277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:00.120804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1139/2275] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:00.131261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:00.133273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:00.200118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eb234-039f-4903-85bd-a267baa7c889 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:00.205256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:00.205256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:00.206078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:00.206886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:00.220106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:00.245721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:00.255921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1137/2276] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:00.787212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:00.789248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:00.801532 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f44dfa-acf6-47b4-af3b-ed9f843fff97 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:00.809503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:00.809503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:00.809503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:00.809503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] PATH_INFO: `/v3/projects/10fc9e6aca7f476ab7597a26c2671768` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:00.810666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fc9e6aca7f476ab7597a26c2671768)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:00.838976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:00.969201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fc9e6aca7f476ab7597a26c2671768', 'request_id': 'req-ba424ada-7012-4b0f-9887-255d8336d0c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:00.984738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fc9e6aca7f476ab7597a26c2671768', 'request_id': 'req-ba424ada-7012-4b0f-9887-255d8336d0c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:00.992875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fc9e6aca7f476ab7597a26c2671768', 'request_id': 'req-ba424ada-7012-4b0f-9887-255d8336d0c4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.061801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] The token cache is being invalidate because project 10fc9e6aca7f476ab7597a26c2671768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:01.062885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.069841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.069841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1140/2277] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:00 2022] DELETE /identity/v3/projects/10fc9e6aca7f476ab7597a26c2671768 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:01.072658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:01.085921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ac702-7dc2-432b-a30c-37dfae5f5344 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:01.164438 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:01.165249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:01.165569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:01.167209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] PATH_INFO: `/v3/users/88672180cbc74fb3a67a2709149a9c25` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:01.167493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88672180cbc74fb3a67a2709149a9c25)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:01.197283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:01.437980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88672180cbc74fb3a67a2709149a9c25'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.542299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88672180cbc74fb3a67a2709149a9c25'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.551079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88672180cbc74fb3a67a2709149a9c25'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.576278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88672180cbc74fb3a67a2709149a9c25'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.577085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ef17f70-f565-49db-875d-fa3dd3af9733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88672180cbc74fb3a67a2709149a9c25'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:01.584074 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1138/2278] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:01 2022] DELETE /identity/v3/users/88672180cbc74fb3a67a2709149a9c25 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:02.145033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:02.146551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:02.163226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424ada-7012-4b0f-9887-255d8336d0c4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:02.249094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:02.249402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.249694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.250000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] PATH_INFO: `/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.251117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6db88a7acf94995b1471fc40c9b9fdf)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:02.279048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:02.400001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6db88a7acf94995b1471fc40c9b9fdf', 'request_id': 'req-5354c0c0-cda5-4d36-8b4b-db88afb22f95'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:02.412478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6db88a7acf94995b1471fc40c9b9fdf', 'request_id': 'req-5354c0c0-cda5-4d36-8b4b-db88afb22f95'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:02.418487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6db88a7acf94995b1471fc40c9b9fdf', 'request_id': 'req-5354c0c0-cda5-4d36-8b4b-db88afb22f95'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:02.487450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] The token cache is being invalidate because project c6db88a7acf94995b1471fc40c9b9fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:02.488039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:02.489045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-5354c0c0-cda5-4d36-8b4b-db88afb22f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:02.490711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1141/2279] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:02 2022] DELETE /identity/v3/projects/c6db88a7acf94995b1471fc40c9b9fdf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:02.497093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.497612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.497712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.521356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:02.523458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:02.602818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1139/2280] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:02.611304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.611858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.612142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.636216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:02.637387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:02.645238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1142/2281] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:02.650540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:02.660212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795eff5-25d4-4eea-b05f-767aa1d4ea9b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:02.665552 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:02.666228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.666523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.666834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.667544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:02.667856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:02.694541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:02.709342 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1140/2282] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:02.721211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:02.724645 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364b9ae-fb60-4134-b0fd-b3af5d825ed2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:02.729361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:02.730103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.730400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.730796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.731536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:02.758975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:02.865383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1143/2283] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:02 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:02.867645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:02.877455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a754-8318-4c8c-8a97-7c06c1e424ab admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:02.949619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:02.950534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:02.951161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:02.951612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:02.952705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:02.980801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:03.123168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1141/2284] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:02 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:03.127409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:03.138519 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178ab3f-30ca-4aaa-a0a6-67fa775c855f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:03.142800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:03.143400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:03.143690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:03.143973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:03.144677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:03.172476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0de35-c4e8-4970-9976-0ded84fa0029 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:03.191683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1144/2285] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:03.196116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:03.206978 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9faf2-38a3-4ae0-adf1-89666a6b113c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:03.210939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:03.211752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:03.212042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:03.212329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] PATH_INFO: `/v3/projects/b47698d477b14bde88e5839e4fbca6bb/users/3a7b93b168964a1aa7c00fdbd42c1cad/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:03.233257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47698d477b14bde88e5839e4fbca6bb, user_id=3a7b93b168964a1aa7c00fdbd42c1cad, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:03.261619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:03.402392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1142/2286] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:03 2022] PUT /identity/v3/projects/b47698d477b14bde88e5839e4fbca6bb/users/3a7b93b168964a1aa7c00fdbd42c1cad/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:03.415220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:03.415445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:03.415731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:03.455913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] MFA Rules not processed for user `3a7b93b168964a1aa7c00fdbd42c1cad`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:03.457080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:03.624342 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1145/2287] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:03.634673 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:03.636613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:03.709567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadc85-66ed-4f60-b4bc-b46c552c06d1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:03.715054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:03.715582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:03.715876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:03.716745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:03.726566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:03.751859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:03.763138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1143/2288] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:03 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:05.844299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:05.846216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:05.939175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116dee-a51b-40bb-b8ad-213ac41eb8f0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:05.954084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:05.954084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:05.954084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:05.954084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] PATH_INFO: `/v3/users/00df2776f7024acc888a4c9b2e1cc891` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:05.954686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00df2776f7024acc888a4c9b2e1cc891)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:05.994139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:06.208465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00df2776f7024acc888a4c9b2e1cc891'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:06.217565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00df2776f7024acc888a4c9b2e1cc891'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:06.330798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00df2776f7024acc888a4c9b2e1cc891'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:06.344647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00df2776f7024acc888a4c9b2e1cc891'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:06.345317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a4193ae2-1fde-48dd-858f-a96e690f144e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00df2776f7024acc888a4c9b2e1cc891'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:06.351334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1146/2289] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:05 2022] DELETE /identity/v3/users/00df2776f7024acc888a4c9b2e1cc891 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:06.685459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:06.696737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb963-1001-4c05-b63b-22508e3308fa service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:06.767637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:06.768316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:06.768603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:06.768879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] PATH_INFO: `/v3/projects/474c373d715f467baa3762fdef8c160a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:06.769994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474c373d715f467baa3762fdef8c160a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:06.796258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:06.960857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474c373d715f467baa3762fdef8c160a', 'request_id': 'req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:07.028199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474c373d715f467baa3762fdef8c160a', 'request_id': 'req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:07.041324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474c373d715f467baa3762fdef8c160a', 'request_id': 'req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:07.051349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] The token cache is being invalidate because project 474c373d715f467baa3762fdef8c160a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:07.051636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:07.052244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3cb9ce27-bca0-4f6b-98db-df3dd6aed242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:07.053745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1144/2290] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:06 2022] DELETE /identity/v3/projects/474c373d715f467baa3762fdef8c160a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:07.058775 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.059235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.059327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.081501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:07.082654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:07.148812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1147/2291] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:07.157244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.157665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.157851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.182433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:07.183910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:07.190816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1145/2292] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:07.195585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:07.205070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540257b-eaca-4c7e-9ca4-93129ea80e82 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:07.209286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:07.210013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.210311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.210688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.211291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:07.211589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:07.237372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:07.252059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1148/2293] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:07.256874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:07.266329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506167d-f49b-4c06-821d-7cd0256c24f9 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:07.270828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:07.271433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.271724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.272064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.272771 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:07.299073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:07.422416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1146/2294] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:07 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:07.426779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:07.437258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e58d-c313-4d32-87f9-5f6e8f4eb6c5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:07.500799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:07.501405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.501690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.501994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.502632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:07.528168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:07.626605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1149/2295] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:07 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:07.630924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:07.641803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f14c8-173c-4e8c-8141-64cce673d5d1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:07.646000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:07.646623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.647419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.647957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.648655 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:07.675400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab686-f465-4d6a-acdb-36a44fffa6c9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:07.686349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1147/2296] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:07.690608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:07.700603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd043-fbc5-4473-a4b8-76b797033c9b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:07.704814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:07.705620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.705907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.706279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] PATH_INFO: `/v3/projects/eb257a7a3bb04c119dfcc636d1d56138/users/67a2b337114d4e3e823bcd4c35efc11e/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.727489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb257a7a3bb04c119dfcc636d1d56138, user_id=67a2b337114d4e3e823bcd4c35efc11e, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:07.753418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:07.878157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1150/2297] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:07 2022] PUT /identity/v3/projects/eb257a7a3bb04c119dfcc636d1d56138/users/67a2b337114d4e3e823bcd4c35efc11e/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:07.889663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:07.889663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:07.890193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:07.932326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] MFA Rules not processed for user `67a2b337114d4e3e823bcd4c35efc11e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:07.933495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:08.008929 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1148/2298] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:08.013225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.086266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20524fa5-23d8-46c7-b3da-d549010aa72c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.090616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.091209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.091497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.091777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.092421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.117703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.246711 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1151/2299] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:08 2022] POST /identity/v3/projects => generated 363 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:08.250802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.265176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033201-d1a6-4330-bca3-57240b98e801 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.331070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.331674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.331962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.332243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.332880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.358579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.471796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1149/2300] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:08 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:08.475990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.485962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3851-13cd-4498-b1c0-69b17e205ea9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.490090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.491180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.491465 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.491749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.492440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.518300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.530320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1152/2301] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:08.534546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.544102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2aa1a-642c-46fb-9f6b-17ecad491b75 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.548420 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.549284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.549563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.549840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] PATH_INFO: `/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.570868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5846d7a20f4a46c1ae4c6fd463a45ea8, user_id=3d7b5d65646745fe8cf2f45f4b7634fe, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.610019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.674112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1150/2302] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:08 2022] PUT /identity/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:08.678805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.688454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba9bec-b433-4186-b9f4-d28bebd15db7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.751377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.751990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.752280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.752563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.753257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.778622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.789960 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1153/2303] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:26:08.793983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.804561 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8273-9ab0-4477-9dae-e2bbdd0c448e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.808756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.809565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.809856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.810180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] PATH_INFO: `/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.811986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5846d7a20f4a46c1ae4c6fd463a45ea8, user_id=3d7b5d65646745fe8cf2f45f4b7634fe, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.838833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.849452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1151/2304] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:08 2022] PUT /identity/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:08.854493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.864860 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d79f2c-ffdb-4287-bcd4-a4d456021426 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.934792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.935409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.935748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.936036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.936758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:08.962457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d41f12-82a6-473c-bb33-d496d3c18663 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:08.973434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1154/2305] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:08.978380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:08.988593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aede55b-dcce-4d8e-96b5-176c5f0b5c39 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:08.994160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:08.994973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:08.995254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:08.995523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] PATH_INFO: `/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:08.997276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5846d7a20f4a46c1ae4c6fd463a45ea8, user_id=3d7b5d65646745fe8cf2f45f4b7634fe, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:09.024658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:09.126963 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1152/2306] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:08 2022] PUT /identity/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8/users/3d7b5d65646745fe8cf2f45f4b7634fe/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:09.138594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:09.139079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:09.140942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:09.177153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] MFA Rules not processed for user `3d7b5d65646745fe8cf2f45f4b7634fe`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:09.178415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:09.253888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1155/2307] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:09.265215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:09.266900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:09.332471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c8d0-7aa5-49f3-b880-62298fd71c34 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:09.336525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:09.337818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:09.337818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:09.343261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:09.347851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:09.373838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b69a-0d56-4c5d-9ea8-169c06e8ee01 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:09.383869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1153/2308] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:09 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:10.467846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:10.537176 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9a48-97de-469a-9cab-931f0c088b11 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:10.542032 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:10.542831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:10.543119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:10.543399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] PATH_INFO: `/v3/users/67a2b337114d4e3e823bcd4c35efc11e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:10.544479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a2b337114d4e3e823bcd4c35efc11e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:10.571486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:10.909730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a2b337114d4e3e823bcd4c35efc11e'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:10.918273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a2b337114d4e3e823bcd4c35efc11e'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:10.993529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a2b337114d4e3e823bcd4c35efc11e'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:11.007964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a2b337114d4e3e823bcd4c35efc11e'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:11.011227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a2b337114d4e3e823bcd4c35efc11e'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:11.015318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1156/2309] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:10 2022] DELETE /identity/v3/users/67a2b337114d4e3e823bcd4c35efc11e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:11.019897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:11.020309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:11.020469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:11.042886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:11.045686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:11.111775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1154/2310] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:11.122037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:11.124527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:11.190464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42926-b5c4-49ab-9657-5935b2325c05 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:11.195149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:11.195434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:11.195720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:11.195996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:11.204774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:11.230839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:11.240005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1157/2311] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:11.760908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:11.762596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:11.776054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0581-b566-4d61-af98-48ea16ddf971 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:11.781611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:11.782515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:11.782703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:11.782979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] PATH_INFO: `/v3/projects/eb257a7a3bb04c119dfcc636d1d56138` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:11.784158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb257a7a3bb04c119dfcc636d1d56138)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:11.811618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:11.987157 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb257a7a3bb04c119dfcc636d1d56138', 'request_id': 'req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.073434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb257a7a3bb04c119dfcc636d1d56138', 'request_id': 'req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.086325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb257a7a3bb04c119dfcc636d1d56138', 'request_id': 'req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.096586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] The token cache is being invalidate because project eb257a7a3bb04c119dfcc636d1d56138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:12.096586 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.097058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.098554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1155/2312] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:11 2022] DELETE /identity/v3/projects/eb257a7a3bb04c119dfcc636d1d56138 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:12.103642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:12.112883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1fd2-1bcf-4c73-b1be-ba6826317b63 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:12.178494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:12.195129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:12.195129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:12.195129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] PATH_INFO: `/v3/users/3d7b5d65646745fe8cf2f45f4b7634fe` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:12.195129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7b5d65646745fe8cf2f45f4b7634fe)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:12.206493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:12.441088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7b5d65646745fe8cf2f45f4b7634fe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.449295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7b5d65646745fe8cf2f45f4b7634fe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.508079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7b5d65646745fe8cf2f45f4b7634fe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.520892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7b5d65646745fe8cf2f45f4b7634fe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.524417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2e46b4a7-8df3-4ff6-8f1e-ebeca5009e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7b5d65646745fe8cf2f45f4b7634fe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:12.528059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1158/2313] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:12 2022] DELETE /identity/v3/users/3d7b5d65646745fe8cf2f45f4b7634fe => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:13.089675 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:13.091320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:13.104347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4bb77-d98b-45cd-9f2c-37f83322dbb0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:13.181330 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:13.187450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.187450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.187450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] PATH_INFO: `/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.187450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5846d7a20f4a46c1ae4c6fd463a45ea8)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:13.209869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:13.377747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5846d7a20f4a46c1ae4c6fd463a45ea8', 'request_id': 'req-d073a387-cfea-49c2-b45f-0a0ba58d6b73'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:13.456486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5846d7a20f4a46c1ae4c6fd463a45ea8', 'request_id': 'req-d073a387-cfea-49c2-b45f-0a0ba58d6b73'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:13.468652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5846d7a20f4a46c1ae4c6fd463a45ea8', 'request_id': 'req-d073a387-cfea-49c2-b45f-0a0ba58d6b73'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:13.480010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] The token cache is being invalidate because project 5846d7a20f4a46c1ae4c6fd463a45ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:13.480293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:13.480946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d073a387-cfea-49c2-b45f-0a0ba58d6b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:13.490290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1156/2314] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:13 2022] DELETE /identity/v3/projects/5846d7a20f4a46c1ae4c6fd463a45ea8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:13.490459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.490459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.490459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.512329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:13.513458 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:13.578849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1159/2315] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:13.587614 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.587910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.588192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.611811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:13.615822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:13.620815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1157/2316] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:13.625192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:13.635638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7372c-da74-4962-8f90-5bc8586b3b03 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:13.640076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:13.644614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.644614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.644614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.644614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:13.644614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:13.668690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:13.681895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1160/2317] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:13.686295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:13.696234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a889ec-b686-45d3-8394-f4f1b91aa034 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:13.700952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:13.701562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.713315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.713315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.713315 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:13.729966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:13.867708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1158/2318] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:13 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:13.872291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:13.883074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455e20-6d5c-4269-a3ec-7cc516d33927 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:13.947529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:13.948139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:13.948424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:13.948703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:13.949337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:13.975552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.125742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1161/2319] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:13 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:14.130319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.143670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551128e-2385-4442-92f0-06a94ee591f8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.148753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.149827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.150147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.150430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.151145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:14.177097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162b60d-4e96-4445-9c5c-dad1783f91df admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.187857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1159/2320] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:26:14.192298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.203380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ae8c5-7409-42a9-810c-62e0232742a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.207771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.208677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.209012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.210565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] PATH_INFO: `/v3/projects/d668f2deef184578ac322657b1e6a381/users/ec0c568dd8cb42088ec97781714ce752/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.236616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d668f2deef184578ac322657b1e6a381, user_id=ec0c568dd8cb42088ec97781714ce752, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:14.264055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.398497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1162/2321] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:14 2022] PUT /identity/v3/projects/d668f2deef184578ac322657b1e6a381/users/ec0c568dd8cb42088ec97781714ce752/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:14.408590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.408888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.409172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.445294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] MFA Rules not processed for user `ec0c568dd8cb42088ec97781714ce752`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:14.446480 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:14.523427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1160/2322] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:14.528160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.547493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.548813 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:14.603758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abaa41-fcae-4421-a567-46e39c3ff55f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.609581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.610320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.610688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.611031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.611973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:14.624359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dd96b-7af6-475c-8e91-3e44677f2901 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.628931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.629739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.630230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.630684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] PATH_INFO: `/v3/users/3a7b93b168964a1aa7c00fdbd42c1cad` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.632448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7b93b168964a1aa7c00fdbd42c1cad)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:14.640267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.664945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.738360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1163/2323] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:14 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:14.742353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.812873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f3e0c-1048-4989-80f4-22c9ae41ee44 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.817418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.818128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.818922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.819205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:14.819839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:14.846558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:14.898587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7b93b168964a1aa7c00fdbd42c1cad'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:14.977054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1164/2324] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:14 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:14.982059 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:14.991540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fd88-3b95-4b5c-bb20-9dbb3617e61c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:14.996886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:14.997496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:14.997875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:14.999410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7b93b168964a1aa7c00fdbd42c1cad'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:15.001747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.003152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.010472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7b93b168964a1aa7c00fdbd42c1cad'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:15.025489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7b93b168964a1aa7c00fdbd42c1cad'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:15.026730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c74dc979-08b3-461c-a99f-f5e2035ed748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7b93b168964a1aa7c00fdbd42c1cad'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:15.033445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1161/2325] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:14 2022] DELETE /identity/v3/users/3a7b93b168964a1aa7c00fdbd42c1cad => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:15.037074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.037658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.038152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.038392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.048728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1165/2326] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:15.052677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.054859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.060865 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:15.062010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.067613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a03-2fab-41c5-aedf-db8cf318400c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.138125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1162/2327] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:15.147545 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.153143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.153143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.153143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] PATH_INFO: `/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.153502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.153502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.171950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c7cb6a85bf430d8e974553ac3a5ff1, user_id=25e9980028fe48cfa5d8c9b51ec163cd, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.200118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.222513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b767-fb1c-4d05-a997-56a6ca5560d1 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.226058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.226756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.227111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.227459 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.236550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.263745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.273575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1163/2328] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:15.283695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1166/2329] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:15 2022] PUT /identity/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:15.289321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.299465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2cc53-7f3f-4956-b4cb-38724f3acca8 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.384513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.385125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.385414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.385704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.386452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.413738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.424491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1164/2330] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:15.429361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.439370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73f71a-c623-4998-a167-8f1f63217032 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.443885 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.444701 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.444985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.445268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] PATH_INFO: `/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.447076 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c7cb6a85bf430d8e974553ac3a5ff1, user_id=25e9980028fe48cfa5d8c9b51ec163cd, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.473453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.484956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1167/2331] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:15 2022] PUT /identity/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:15.488970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.500434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f8b9-7716-471f-b71f-ec5ef36267bb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.566951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.567589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.567947 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.568296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.569116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.595233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60cd05-3144-4404-a19d-0092911769e5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.607607 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1165/2332] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:15.611894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.626494 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345549-5cc6-4eea-8026-0e6091b43ff1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.632309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.633167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.633456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.633741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] PATH_INFO: `/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.635641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c7cb6a85bf430d8e974553ac3a5ff1, user_id=25e9980028fe48cfa5d8c9b51ec163cd, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.662018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:15.770350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1168/2333] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:15 2022] PUT /identity/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1/users/25e9980028fe48cfa5d8c9b51ec163cd/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:15.781876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.782204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.782492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.822674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] MFA Rules not processed for user `25e9980028fe48cfa5d8c9b51ec163cd`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:15.823841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.865913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.867934 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.922928 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1166/2334] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:15.933418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:15.934956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:15.948653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8f509-b5fb-4025-ae35-90278a583bf4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:15.953131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:15.954071 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:15.954358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:15.954683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] PATH_INFO: `/v3/projects/b47698d477b14bde88e5839e4fbca6bb` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:15.955817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47698d477b14bde88e5839e4fbca6bb)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:15.982193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.003817 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e445f2-3bfc-4f7b-b5af-da9e7b0a7b89 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.007481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.008065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.008354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.008636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.018318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.049313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15c4cc-d711-4284-b3ee-12717b50eb41 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.062875 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1167/2335] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:26:16.091469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47698d477b14bde88e5839e4fbca6bb', 'request_id': 'req-10a36636-4021-4ae5-8f1f-d71413cd1f24'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:16.105948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47698d477b14bde88e5839e4fbca6bb', 'request_id': 'req-10a36636-4021-4ae5-8f1f-d71413cd1f24'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:16.111155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47698d477b14bde88e5839e4fbca6bb', 'request_id': 'req-10a36636-4021-4ae5-8f1f-d71413cd1f24'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:16.173694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] The token cache is being invalidate because project b47698d477b14bde88e5839e4fbca6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:16.174034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:16.174660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-10a36636-4021-4ae5-8f1f-d71413cd1f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:16.176293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1169/2336] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:15 2022] DELETE /identity/v3/projects/b47698d477b14bde88e5839e4fbca6bb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:16.181170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.181626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.181737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.207549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:16.208624 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:16.282502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1168/2337] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:16.293585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.293973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.294268 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.305195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.306567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:16.317048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:16.318809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:16.327237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1170/2338] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:16.331536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.340889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ba2f1-19f0-4a51-a825-4f4f6dd56073 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.345207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.345807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.346129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.346410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.347122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:16.347404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.373023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6241-1c93-4678-9478-b4d921050175 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.373253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.376519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.377109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.377401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.377686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.379685 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:16.388115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1171/2339] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:26:16.394761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.406970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31a0c-6def-4189-837b-ddd9665b0edc admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.411234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.411822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.412180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.412631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.413285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.439575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.451906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.477713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.487189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1169/2340] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:26:16.551435 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1172/2341] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:16.556266 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.568199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458357-617d-4fdb-a411-cbef7a5cd699 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.642408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.643014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.643302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.645570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.645570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.678926 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.768008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1170/2342] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:16 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:16.772612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.785101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ed9e-9b77-4677-9e81-ac7091c399a7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.790884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.791472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.791755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.792028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.792709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.821590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8141384-8bbd-458a-838f-c39c1a6ee879 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:16.837070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1173/2343] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:16.840248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:16.853770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a6591-83b8-4e50-aea1-92c273dcf9c5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:16.859583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:16.860093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:16.860377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:16.860653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] PATH_INFO: `/v3/projects/ba04e8ff317a485fa2c9f0a183a0828c/users/b95853c70f5b40699aeb7c36d8818fb4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:16.883022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba04e8ff317a485fa2c9f0a183a0828c, user_id=b95853c70f5b40699aeb7c36d8818fb4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:16.916324 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.000504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1171/2344] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:16 2022] PUT /identity/v3/projects/ba04e8ff317a485fa2c9f0a183a0828c/users/b95853c70f5b40699aeb7c36d8818fb4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:17.011873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.012175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.012461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.055803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] MFA Rules not processed for user `b95853c70f5b40699aeb7c36d8818fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:17.056942 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:17.133481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1174/2345] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:17 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:17.138530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.209893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ff92-e6a7-4c15-8608-6d389e5a0f32 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.214388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.215014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.215302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.215612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.216268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.242851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.344537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1172/2346] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:17 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:17.348321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.359333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6357bf1-7393-40c7-9d16-311ea9856693 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.422888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.422888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.422888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.422888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.423521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.452471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.542636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1175/2347] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:17 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:17.546632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.556873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c9edb-de61-41ab-80f1-de6af8f45235 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.561128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.561710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.562038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.562321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.563012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.589221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.601115 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1173/2348] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:17.605358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.615105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131082d-4c95-4719-a2fd-9863a04f5c38 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.619462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.620267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.620570 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.620833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] PATH_INFO: `/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.640720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=738032dc4e9443bd93f72a2c3484dab6, user_id=3f93e207b59a45d09b5eec04ae949faa, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.667538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.731295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1176/2349] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:17 2022] PUT /identity/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:17.735380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.745112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e5db-2e85-49ac-a045-eb6df99c9e9a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.807255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.807859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.808152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.808435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.809132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.835656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.846316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1174/2350] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:17.850337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.860222 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1de10-5135-4232-a1c5-7912373450ea admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.864664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.865566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.865850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.866162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] PATH_INFO: `/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.867936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] RBAC: Authorizing `identity:create_grant(project_id=738032dc4e9443bd93f72a2c3484dab6, user_id=3f93e207b59a45d09b5eec04ae949faa, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:17.895002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:17.906020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1177/2351] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:17 2022] PUT /identity/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:17.909979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:17.920100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b066bc-c507-4339-ab05-a2da4a796aa1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:17.985136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:17.985862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:17.986189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:17.986476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:17.987210 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:18.015766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed0f3c-78fa-45a7-992f-8276482440ec admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:18.027007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1175/2352] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:18.031130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:18.042442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea07c-937a-4034-bbe4-2fb37675483b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:18.047857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:18.048817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:18.049102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:18.049380 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] PATH_INFO: `/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:18.051397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738032dc4e9443bd93f72a2c3484dab6, user_id=3f93e207b59a45d09b5eec04ae949faa, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:18.086333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:18.206312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1178/2353] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:18 2022] PUT /identity/v3/projects/738032dc4e9443bd93f72a2c3484dab6/users/3f93e207b59a45d09b5eec04ae949faa/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:18.217540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:18.218148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:18.218410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:18.256223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] MFA Rules not processed for user `3f93e207b59a45d09b5eec04ae949faa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:18.266886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:18.337206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1176/2354] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:18.347002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:18.412721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb33c9-42f4-4e38-9832-c6f6174a2234 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:18.416633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:18.417224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:18.417535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:18.417820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:18.484807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:18.511868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fad10-bf8f-4a54-9df2-71a570ab8dcb service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:18.523734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1179/2355] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:20.206892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:20.208284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:20.285003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c72651-f76c-4af6-b879-566bb9015c8c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:20.289181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:20.290176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:20.290468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:20.290747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] PATH_INFO: `/v3/users/ec0c568dd8cb42088ec97781714ce752` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:20.291868 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0c568dd8cb42088ec97781714ce752)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:20.317719 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:20.516454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0c568dd8cb42088ec97781714ce752'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:20.590812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0c568dd8cb42088ec97781714ce752'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:20.598825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0c568dd8cb42088ec97781714ce752'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:20.610419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0c568dd8cb42088ec97781714ce752'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:20.611049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0c568dd8cb42088ec97781714ce752'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:20.617742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1177/2356] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:20 2022] DELETE /identity/v3/users/ec0c568dd8cb42088ec97781714ce752 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:20.622418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:20.628615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:20.628615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:20.645810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:20.647167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:20.725894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1180/2357] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:20.732242 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:20.733725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:20.800881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc6e2-00c6-46b0-b621-efd6d0c580d3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:20.804323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:20.804906 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:20.805199 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:20.805483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:20.814872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:20.841419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:20.850523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1178/2358] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:21.338367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:21.340446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:21.358109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65fdd-a315-4e78-9a67-8d5ea4a8f0e1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:21.364614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:21.365949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:21.366441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:21.367414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] PATH_INFO: `/v3/projects/d668f2deef184578ac322657b1e6a381` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:21.369174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d668f2deef184578ac322657b1e6a381)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:21.403543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:21.516495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd668f2deef184578ac322657b1e6a381', 'request_id': 'req-1f13535e-c0a1-476e-809a-0f23226f8de0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.529576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd668f2deef184578ac322657b1e6a381', 'request_id': 'req-1f13535e-c0a1-476e-809a-0f23226f8de0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.534509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd668f2deef184578ac322657b1e6a381', 'request_id': 'req-1f13535e-c0a1-476e-809a-0f23226f8de0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.605024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] The token cache is being invalidate because project d668f2deef184578ac322657b1e6a381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:21.605240 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.605813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.607445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1181/2359] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:21 2022] DELETE /identity/v3/projects/d668f2deef184578ac322657b1e6a381 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:21.611377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:21.622888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235d5d-ceb8-4665-b0f7-c82a36678975 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:21.703604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:21.704469 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:21.704808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:21.705075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] PATH_INFO: `/v3/users/25e9980028fe48cfa5d8c9b51ec163cd` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:21.706256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e9980028fe48cfa5d8c9b51ec163cd)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:21.735946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:21.808218 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:21.810569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:21.829148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13535e-c0a1-476e-809a-0f23226f8de0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:21.833841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:21.834681 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:21.834967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:21.835247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] PATH_INFO: `/v3/users/b95853c70f5b40699aeb7c36d8818fb4` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:21.837530 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95853c70f5b40699aeb7c36d8818fb4)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:21.867443 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:21.898638 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e9980028fe48cfa5d8c9b51ec163cd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.985082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e9980028fe48cfa5d8c9b51ec163cd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:21.995961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e9980028fe48cfa5d8c9b51ec163cd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.008316 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e9980028fe48cfa5d8c9b51ec163cd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.008949 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5da9a7b-caeb-4d91-ac07-b1ba48a4cc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e9980028fe48cfa5d8c9b51ec163cd'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.016498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1179/2360] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:21 2022] DELETE /identity/v3/users/25e9980028fe48cfa5d8c9b51ec163cd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:22.060719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95853c70f5b40699aeb7c36d8818fb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.078379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95853c70f5b40699aeb7c36d8818fb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.193378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95853c70f5b40699aeb7c36d8818fb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.206392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95853c70f5b40699aeb7c36d8818fb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.206985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95853c70f5b40699aeb7c36d8818fb4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.213688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1182/2361] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:21 2022] DELETE /identity/v3/users/b95853c70f5b40699aeb7c36d8818fb4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:22.218111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:22.218414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:22.218704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:22.240132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:22.241273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:22.311069 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1180/2362] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:22.322183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:22.324306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:22.413295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089b5c-dca7-438c-a1e8-40a4c5b0438f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:22.417915 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:22.418540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:22.418819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:22.419126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:22.428998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:22.454819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80c710-511c-4225-9fd4-0c98e8aa230b service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:22.465726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1183/2363] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:22.674977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:22.676644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:22.688903 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc381b-3cb0-43f3-bcf9-6c3cb3356422 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:22.693411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:22.699393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:22.699393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:22.699393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] PATH_INFO: `/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:22.699393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c7cb6a85bf430d8e974553ac3a5ff1)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:22.723310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:22.886983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c7cb6a85bf430d8e974553ac3a5ff1', 'request_id': 'req-67aac258-e3de-4212-b539-14e6dbba8fb4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:22.982617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c7cb6a85bf430d8e974553ac3a5ff1', 'request_id': 'req-67aac258-e3de-4212-b539-14e6dbba8fb4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.010169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c7cb6a85bf430d8e974553ac3a5ff1', 'request_id': 'req-67aac258-e3de-4212-b539-14e6dbba8fb4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.022520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] The token cache is being invalidate because project d0c7cb6a85bf430d8e974553ac3a5ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:23.022900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.024587 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-67aac258-e3de-4212-b539-14e6dbba8fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.026708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1181/2364] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:22 2022] DELETE /identity/v3/projects/d0c7cb6a85bf430d8e974553ac3a5ff1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:23.033628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.034766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.035367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.075642 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:23.077468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:23.194180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1184/2365] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:23.207775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.208239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.208804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.218202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.220304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:23.243506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c5d99-3f86-489c-ab56-4097792ad7d6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.258819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.260592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.261257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.261788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] PATH_INFO: `/v3/projects/ba04e8ff317a485fa2c9f0a183a0828c` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.262314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:23.263804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba04e8ff317a485fa2c9f0a183a0828c)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.265391 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:23.279953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1182/2366] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:23.285183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.302396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd3a4-4280-498f-8b6c-4e1288e3a865 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.312516 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.314371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.314371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.314371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.317815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.318542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:23.318542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.368728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.393219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1183/2367] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:23.399931 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.416197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fb450-acd6-4429-80a1-e97c015e5cc0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.423945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.424918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.425860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.426360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.427418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.474690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba04e8ff317a485fa2c9f0a183a0828c', 'request_id': 'req-389d7ff7-560e-466d-ae84-5fdd853915a4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.476755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.500042 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba04e8ff317a485fa2c9f0a183a0828c', 'request_id': 'req-389d7ff7-560e-466d-ae84-5fdd853915a4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.509894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba04e8ff317a485fa2c9f0a183a0828c', 'request_id': 'req-389d7ff7-560e-466d-ae84-5fdd853915a4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.578631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1184/2368] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:23 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:23.583328 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.591479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] The token cache is being invalidate because project ba04e8ff317a485fa2c9f0a183a0828c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:23.591931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.592423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.596895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1185/2369] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:23 2022] DELETE /identity/v3/projects/ba04e8ff317a485fa2c9f0a183a0828c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:23.598127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.599542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:23.666618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd671-56f9-4690-b4f5-5242bf698dbe admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.671294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.671914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.672186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.672465 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.673097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.682986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7ff7-560e-466d-ae84-5fdd853915a4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.687748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.688558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.697636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.697636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] PATH_INFO: `/v3/users/3f93e207b59a45d09b5eec04ae949faa` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.697636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f93e207b59a45d09b5eec04ae949faa)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.700256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.716193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.923053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1185/2370] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:23 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:23.927348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.928951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:23.941015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857526f7-7783-4aa1-9605-2fac9ba6fe88 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:23.945298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:23.945901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:23.946233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:23.947403 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:23.948807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:23.963165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f93e207b59a45d09b5eec04ae949faa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.972306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f93e207b59a45d09b5eec04ae949faa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:23.973451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:23.984582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1186/2371] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:26:23.988846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:23.999139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3d1c-1d4c-49bc-95e2-c6f6065e3a6c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.004194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.005006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.006156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.006156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] PATH_INFO: `/v3/projects/861190128d3b4754987632500ec26488/users/4fa22f12adb946c28c27e6ad6df8c311/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.027275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=861190128d3b4754987632500ec26488, user_id=4fa22f12adb946c28c27e6ad6df8c311, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.053987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.073385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f93e207b59a45d09b5eec04ae949faa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.087115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f93e207b59a45d09b5eec04ae949faa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.088533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2a8c9b16-de9a-46ee-ae85-de1a5d64e619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f93e207b59a45d09b5eec04ae949faa'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.094653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1186/2372] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:23 2022] DELETE /identity/v3/users/3f93e207b59a45d09b5eec04ae949faa => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:24.113495 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1187/2373] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:23 2022] PUT /identity/v3/projects/861190128d3b4754987632500ec26488/users/4fa22f12adb946c28c27e6ad6df8c311/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:24.129303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.129606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.129877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.189791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] MFA Rules not processed for user `4fa22f12adb946c28c27e6ad6df8c311`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:24.191319 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:24.289847 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1187/2374] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:24.294596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:24.296311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:24.377035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40005-481b-4a42-a4e9-72d199d063dd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.382025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.384664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.384664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.384664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.384664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.411273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.528610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1188/2375] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:24 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:24.531538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:24.542035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6ae0-b47a-46a8-bcf6-88d931a1755b None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.588185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:24.590056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:24.615401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.616013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.616301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.616733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.617226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.644468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.670748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d8c3-eea0-4e3e-ad1c-3a0d78ad3a39 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.675209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.676001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.676292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.676576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] PATH_INFO: `/v3/projects/738032dc4e9443bd93f72a2c3484dab6` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.677723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738032dc4e9443bd93f72a2c3484dab6)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.703975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.763131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1188/2376] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:24 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:24.767054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:24.776687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297245a-de54-400c-b85c-70e011ac4095 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.780940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.784694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.784694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.784694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.784694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.809754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.819027 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738032dc4e9443bd93f72a2c3484dab6', 'request_id': 'req-880bb4f6-78d3-48c2-af43-34fe49abf707'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.821061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1189/2377] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:26:24.825175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:24.834529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d4d22-f6cf-4b29-ba8c-3d9d4be88f19 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:24.898388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:24.899354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.899671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.899996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] PATH_INFO: `/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:24.919143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bbdfce46cb4ff09028d705b1bfcc74, user_id=3107677d277742fc81a904e921a49179, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:24.942597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738032dc4e9443bd93f72a2c3484dab6', 'request_id': 'req-880bb4f6-78d3-48c2-af43-34fe49abf707'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.949894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:24.957827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738032dc4e9443bd93f72a2c3484dab6', 'request_id': 'req-880bb4f6-78d3-48c2-af43-34fe49abf707'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.970060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] The token cache is being invalidate because project 738032dc4e9443bd93f72a2c3484dab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:24.970535 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.971358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-880bb4f6-78d3-48c2-af43-34fe49abf707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:24.972805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1189/2378] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:24 2022] DELETE /identity/v3/projects/738032dc4e9443bd93f72a2c3484dab6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:24.979343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d6e8-3f1d-463f-a93c-425a25ab13ad None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:24.979864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d6e8-3f1d-463f-a93c-425a25ab13ad None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:24.980367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0d6e8-3f1d-463f-a93c-425a25ab13ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.018017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c4c0d6e8-3f1d-463f-a93c-425a25ab13ad None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:25.019174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c4c0d6e8-3f1d-463f-a93c-425a25ab13ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.026981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1190/2379] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:25.047793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.048085 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.048375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.054762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1190/2380] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:24 2022] PUT /identity/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:25.064253 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.068182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.083551 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:25.084692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.149546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2319-7206-4d27-8f48-4afc4abd7263 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.154026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.154633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.154922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.155204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.155780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1191/2381] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:25.155931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.159922 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.169089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76ea3-fec5-41cd-a58e-0b82110eaf23 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.174339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.174946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.175072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.175285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.176118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:25.177180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.185280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.198441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1191/2382] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:25.202680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.208747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.214055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95ea6-a7a2-49f1-b90e-046aaca61f4a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.219888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.220764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.221050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.221412 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] PATH_INFO: `/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.223459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bbdfce46cb4ff09028d705b1bfcc74, user_id=3107677d277742fc81a904e921a49179, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.223948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1192/2383] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:25.230421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.240590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742da6a-d16d-44d6-8288-140a1803d32b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.248423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.248423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.248423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.248423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.251072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.251605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.263223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1192/2384] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:25 2022] PUT /identity/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:25.267473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.273901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.346456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221187f1-b8b5-4cc8-9023-619a45928758 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.359585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.359585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.359585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.359585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.360054 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.386112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.395504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1193/2385] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:25 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:25.397622 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1193/2386] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:25.407416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.407581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.418269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5e6d-5b4c-4838-9b90-48c97a7c04ac admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.489050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988536df-9b40-4e9b-b2f1-46348f1e6da3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.490216 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.490901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.491313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.491688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.493122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.494698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.495628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.495990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.496349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] PATH_INFO: `/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.498695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bbdfce46cb4ff09028d705b1bfcc74, user_id=3107677d277742fc81a904e921a49179, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.518888 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.528017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00291f94-6c55-4279-a470-335f09652bea admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.606786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1194/2387] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:25 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:25.608072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.618309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0e41-a4b4-4953-87d2-99968b24ca31 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.622724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.623318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.623806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.623943 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.624670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.631547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1194/2388] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:25 2022] PUT /identity/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74/users/3107677d277742fc81a904e921a49179/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:25.643286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.643615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.643907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.651188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.662492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1195/2389] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:26:25.667436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.676865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b339f-727b-4e65-b0e6-bec0dd1916c0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.682433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] MFA Rules not processed for user `3107677d277742fc81a904e921a49179`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:25.683593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.745450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.746321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.746609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.746893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] PATH_INFO: `/v3/projects/0dd04931d23f405cb2efa2a651dd0435/users/1db0a8ece2264d6ea3b1712d7b0adf5a/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.764798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1195/2390] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:25.770695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd04931d23f405cb2efa2a651dd0435, user_id=1db0a8ece2264d6ea3b1712d7b0adf5a, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:25.775636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:25.777073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.798841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef89-9338-4ddc-a827-7241a9593fa9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:25.897620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1196/2391] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:25 2022] PUT /identity/v3/projects/0dd04931d23f405cb2efa2a651dd0435/users/1db0a8ece2264d6ea3b1712d7b0adf5a/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:25.910020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.910402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.910750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:25.935026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec8df0-3470-4f44-9d44-ffb636e9bef1 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:25.957074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] MFA Rules not processed for user `1db0a8ece2264d6ea3b1712d7b0adf5a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:25.958635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:25.998310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:25.998879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:25.999164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:25.999443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.001097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:26.035100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1197/2392] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:26:26.039708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:26.068499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.094789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:26.104163 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1196/2393] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:26:26.109101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655601-efb8-4aa8-9e18-e8fe1f98a2d1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:26.114325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:26.114879 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.115189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.115529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.116234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.149614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:26.261407 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1198/2394] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:26.265405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:26.275539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85957a09-684f-4400-8d1e-423b32dbbee7 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:26.341279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:26.341883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.342197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.342474 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.343103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.370619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:26.491473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1197/2395] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:26 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:26.495736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:26.510281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a2bc-ea44-440d-bf31-215794e14f33 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:26.517630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:26.517630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.517630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.517630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.518365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.543923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d6e2-27be-448d-afbd-eb922b5b3013 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:26.554795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1199/2396] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:26.559448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:26.569235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339c1d4-3f5e-406e-819b-573d9b062111 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:26.575862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:26.576694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.576981 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.577270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] PATH_INFO: `/v3/projects/8bb8a019d6c045eebc3b40b4807875d3/users/f6407061682c40e8afeac906728f5c45/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.598777 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8a019d6c045eebc3b40b4807875d3, user_id=f6407061682c40e8afeac906728f5c45, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.625666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:26.720361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1198/2397] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:26 2022] PUT /identity/v3/projects/8bb8a019d6c045eebc3b40b4807875d3/users/f6407061682c40e8afeac906728f5c45/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:26.732844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.732844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.732844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.768270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] MFA Rules not processed for user `f6407061682c40e8afeac906728f5c45`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:26.769462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:26.853295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1200/2398] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:26.857768 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:26.926833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84805c-2be3-4bfa-a389-027cd49faa1f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:26.931374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:26.931967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:26.932270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:26.932534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:26.933174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:26.959808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.069082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1199/2399] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:27.075112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.086936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7a02-4b9a-4a09-9462-f29af51628e6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.150126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.150781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.151012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.151293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.151936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.177291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.273242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1201/2400] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:27 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:26:27.277479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.287283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c4db2-42c3-4227-8de6-757fdb60066b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.291986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.292569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.292854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.293129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.293814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.321038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.332059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1200/2401] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:27.336481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.346234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870df69-6c4b-4454-801a-1444494535d0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.351357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.352266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.352603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.352887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] PATH_INFO: `/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.374005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7211835f81e4253b65ceb1e9f44b0ab, user_id=46664328110c45f3a64aaed8c8266ac5, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.400977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.495838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1202/2402] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:27 2022] PUT /identity/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:27.499534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.509748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87050d-2504-4e3a-a6aa-b1cad5403137 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.574818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.575422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.575709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.576012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.576705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.602579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.613009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1201/2403] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:27.618090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.628553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e22d1-9015-4ec4-a861-4cd35b8a59f9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.633288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.634131 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.634415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.634691 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] PATH_INFO: `/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.636445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7211835f81e4253b65ceb1e9f44b0ab, user_id=46664328110c45f3a64aaed8c8266ac5, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.663152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.674631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1203/2404] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:27 2022] PUT /identity/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:27.680502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.690079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df160a9a-ce3c-48e6-8d9a-bc2a32bd447b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.755641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.756134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.756417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.756694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.757892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.783509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a604f-8674-4e5e-aa0f-ff00e2bac685 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.794344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1202/2405] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:27.798892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:27.810661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5e41f-c5ca-45a8-8373-206047682803 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:27.815723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:27.816585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.816820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.817096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] PATH_INFO: `/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.818880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7211835f81e4253b65ceb1e9f44b0ab, user_id=46664328110c45f3a64aaed8c8266ac5, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:27.847173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:27.921387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1204/2406] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:27 2022] PUT /identity/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab/users/46664328110c45f3a64aaed8c8266ac5/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:27.932933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:27.933505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:27.933654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:27.976755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] MFA Rules not processed for user `46664328110c45f3a64aaed8c8266ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:27.978048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:28.058208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1203/2407] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:28.069308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:28.071949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:28.140481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8902-8210-46c2-8116-051ee63e6975 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:28.145119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:28.145764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:28.146081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:28.146364 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:28.217503 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:28.244247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:28.254909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1205/2408] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:32.544270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:32.555135 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07d2f-017f-4a3d-b5e9-4319eeaa8ad0 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:32.561000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:32.562049 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:32.567627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:32.567627 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:32.633779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:32.659397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:32.669600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1204/2409] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:32.728578 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:32.736963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3fb91-a41f-479a-8acb-e5368fe04117 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:32.740438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:32.741016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:32.741303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:32.741582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:32.809456 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:32.834035 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:32.844921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1206/2410] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:34.414462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:34.424727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f523-d7ab-4464-b307-5af28018d07f service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:34.428566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:34.429257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:34.429652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:34.430062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:34.442252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:34.468228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1693d3-5c01-4a5d-86a6-7246d92d6c86 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:34.480528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1205/2411] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:34 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:43.912340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:43.987830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61cca6-d02e-46e6-90ac-6cb92daaf961 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:43.992053 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:43.992857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:43.993136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:43.993410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] PATH_INFO: `/v3/users/1db0a8ece2264d6ea3b1712d7b0adf5a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:43.995276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db0a8ece2264d6ea3b1712d7b0adf5a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:44.020987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:44.202990 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db0a8ece2264d6ea3b1712d7b0adf5a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:44.210973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db0a8ece2264d6ea3b1712d7b0adf5a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:44.278590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db0a8ece2264d6ea3b1712d7b0adf5a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:44.300757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db0a8ece2264d6ea3b1712d7b0adf5a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:44.300757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db0a8ece2264d6ea3b1712d7b0adf5a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:44.309338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1207/2412] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:43 2022] DELETE /identity/v3/users/1db0a8ece2264d6ea3b1712d7b0adf5a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:44.315530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:44.316109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:44.316629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:44.350004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:44.351850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:44.430703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1206/2413] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:44.440262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:44.441770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:44.516217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28088ccf-4365-4d31-809b-a66a4e9b63e0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:44.519778 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:44.520499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:44.520792 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:44.521075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:44.530688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:44.556501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:44.567554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1208/2414] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:45.157983 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:45.159437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:45.173919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71ae7c-14fd-494a-b39d-9804b8d91a69 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:45.178352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:45.179195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:45.179486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:45.179797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] PATH_INFO: `/v3/projects/0dd04931d23f405cb2efa2a651dd0435` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:45.180887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd04931d23f405cb2efa2a651dd0435)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:45.210982 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:45.378370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd04931d23f405cb2efa2a651dd0435', 'request_id': 'req-1ec41623-e9b2-4aea-89ac-b998cdb19580'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.498728 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd04931d23f405cb2efa2a651dd0435', 'request_id': 'req-1ec41623-e9b2-4aea-89ac-b998cdb19580'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.511837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd04931d23f405cb2efa2a651dd0435', 'request_id': 'req-1ec41623-e9b2-4aea-89ac-b998cdb19580'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.521523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] The token cache is being invalidate because project 0dd04931d23f405cb2efa2a651dd0435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:45.521807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.522447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.524001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1207/2415] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:45 2022] DELETE /identity/v3/projects/0dd04931d23f405cb2efa2a651dd0435 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:45.529044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:45.538281 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d2b0d-ad71-4645-9248-ae74017a50f2 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:45.605748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:45.606596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:45.606883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:45.607164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] PATH_INFO: `/v3/users/f6407061682c40e8afeac906728f5c45` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:45.608375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6407061682c40e8afeac906728f5c45)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:45.636951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:45.917116 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6407061682c40e8afeac906728f5c45'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.925506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6407061682c40e8afeac906728f5c45'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:45.979378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:45.981271 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:46.053920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6407061682c40e8afeac906728f5c45'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:46.075950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6407061682c40e8afeac906728f5c45'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:46.079223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6407061682c40e8afeac906728f5c45'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:46.087527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1209/2416] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:45 2022] DELETE /identity/v3/users/f6407061682c40e8afeac906728f5c45 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:46.092148 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41623-e9b2-4aea-89ac-b998cdb19580 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:46.163915 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:46.164581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:46.164893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:46.165178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:46.168415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:46.282578 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:46.321361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:46.338212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1208/2417] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:26:47.208928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:47.210628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:47.223661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0dec-68c3-4d7b-a07e-a68211469673 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:47.229852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:47.230980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:47.232726 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:47.233024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] PATH_INFO: `/v3/projects/8bb8a019d6c045eebc3b40b4807875d3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:47.234244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb8a019d6c045eebc3b40b4807875d3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:47.261356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:47.407585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb8a019d6c045eebc3b40b4807875d3', 'request_id': 'req-06ff1010-21a6-4cac-a72a-3393d42db10a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:47.423951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb8a019d6c045eebc3b40b4807875d3', 'request_id': 'req-06ff1010-21a6-4cac-a72a-3393d42db10a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:47.431833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb8a019d6c045eebc3b40b4807875d3', 'request_id': 'req-06ff1010-21a6-4cac-a72a-3393d42db10a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:47.552585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] The token cache is being invalidate because project 8bb8a019d6c045eebc3b40b4807875d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:47.552925 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:47.553524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:47.555780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1210/2418] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:47 2022] DELETE /identity/v3/projects/8bb8a019d6c045eebc3b40b4807875d3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:47.561912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:47.575634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f90947-96b9-482a-a164-b712d17fa22e service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:47.657248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:47.658119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:47.658398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:47.658708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] PATH_INFO: `/v3/users/46664328110c45f3a64aaed8c8266ac5` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:47.659870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46664328110c45f3a64aaed8c8266ac5)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:47.686546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:47.938156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46664328110c45f3a64aaed8c8266ac5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.019281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46664328110c45f3a64aaed8c8266ac5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.030778 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46664328110c45f3a64aaed8c8266ac5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.044557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46664328110c45f3a64aaed8c8266ac5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.045366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cb7e624-3844-4b0c-b294-d5ff25ccc728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46664328110c45f3a64aaed8c8266ac5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.053028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1209/2419] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:47 2022] DELETE /identity/v3/users/46664328110c45f3a64aaed8c8266ac5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:48.691306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:48.691306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:48.713286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff1010-21a6-4cac-a72a-3393d42db10a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:48.793832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:48.794734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:48.795027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:48.795306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] PATH_INFO: `/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:48.796438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7211835f81e4253b65ceb1e9f44b0ab)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:48.824723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:48.964567 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7211835f81e4253b65ceb1e9f44b0ab', 'request_id': 'req-a2349c1a-cd96-4a2c-8399-776b233fc5c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.983773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7211835f81e4253b65ceb1e9f44b0ab', 'request_id': 'req-a2349c1a-cd96-4a2c-8399-776b233fc5c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:48.988295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7211835f81e4253b65ceb1e9f44b0ab', 'request_id': 'req-a2349c1a-cd96-4a2c-8399-776b233fc5c5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:49.115794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] The token cache is being invalidate because project b7211835f81e4253b65ceb1e9f44b0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:49.116351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:49.117228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a2349c1a-cd96-4a2c-8399-776b233fc5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:49.120982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1211/2420] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:48 2022] DELETE /identity/v3/projects/b7211835f81e4253b65ceb1e9f44b0ab => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:49.126781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.128012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.128332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.164105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:49.164962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:49.266090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1210/2421] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:49.271279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.271279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.271279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.301119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:49.302871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:49.312195 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1212/2422] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:49.317797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:49.328416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477a887-f5ca-4278-a1f3-3a7bbc784b05 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:49.333413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:49.334203 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.334449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.334939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.335715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:49.336088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:49.363250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:49.379497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1211/2423] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:26:49.390798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:49.405236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518664f-ce8b-4218-aa23-e41a868d7f46 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:49.409963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:49.410583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.410897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.411182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.411829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:49.439779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:49.537391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1213/2424] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:49 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:49.542756 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:49.554754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98cef9-ab4e-4f2a-baec-879767c74c07 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:49.630406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:49.631224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.631532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.631840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.632597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:49.661232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:49.777914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1212/2425] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:49 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:49.779127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:49.791819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c414c-d330-443d-b8e5-13abf98820ad admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:49.799092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:49.799753 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.800088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.800433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.801202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:49.829663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd2afc-e1e9-434e-b6e6-8362569e679f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:49.842079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1214/2426] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:49.846443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:49.860063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322940-a576-42e7-b231-01243238afc5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:49.864609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:49.865567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:49.866065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:49.866354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] PATH_INFO: `/v3/projects/492a540ce68041ba95947bda771f2b12/users/e8cdeb95ec014c53887318b82f1e092d/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:49.895082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492a540ce68041ba95947bda771f2b12, user_id=e8cdeb95ec014c53887318b82f1e092d, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:49.934705 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:50.046256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1213/2427] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:49 2022] PUT /identity/v3/projects/492a540ce68041ba95947bda771f2b12/users/e8cdeb95ec014c53887318b82f1e092d/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:50.058619 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7f318-2c90-4346-86db-01ff40875fe2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:50.059337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7f318-2c90-4346-86db-01ff40875fe2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:50.059963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7f318-2c90-4346-86db-01ff40875fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:50.133063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-1cf7f318-2c90-4346-86db-01ff40875fe2 None None] MFA Rules not processed for user `e8cdeb95ec014c53887318b82f1e092d`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:50.135069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-1cf7f318-2c90-4346-86db-01ff40875fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:50.230026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1215/2428] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:50.247513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:50.250214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:50.355517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb372-cecf-4ded-9a09-fa4e190752e3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:50.366746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:50.368966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:50.369745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:50.370504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:50.391677 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:50.432393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:50.446806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1214/2429] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:50 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:26:52.844505 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:52.845073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:52.845073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:52.869093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] MFA Rules not processed for user `e8cdeb95ec014c53887318b82f1e092d`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:52.870790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:52.879843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1216/2430] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:55.792904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:55.794637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:55.886732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188270d0-e61a-4e42-a1cc-4fd8dbef59ef service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:55.891067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:55.891870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:55.892189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:55.892470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] PATH_INFO: `/v3/users/279b268212d54d95b10267e7658722df` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:55.895506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b268212d54d95b10267e7658722df)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:55.923297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:56.148880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b268212d54d95b10267e7658722df'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.227099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b268212d54d95b10267e7658722df'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.236435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b268212d54d95b10267e7658722df'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.250048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b268212d54d95b10267e7658722df'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.250945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-58fb89a5-1329-40cf-8c66-d451cb9b9fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b268212d54d95b10267e7658722df'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.257713 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1215/2431] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:26:55 2022] DELETE /identity/v3/users/279b268212d54d95b10267e7658722df => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:26:56.663912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:56.676846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96746eb-e983-49e7-b6c8-3327a98a3b11 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:56.762267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:56.763293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:56.763631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:56.763911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] PATH_INFO: `/v3/projects/872b80d8f161486ab774165084e4feca` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:56.765088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=872b80d8f161486ab774165084e4feca)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:56.794895 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:56.972856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872b80d8f161486ab774165084e4feca', 'request_id': 'req-49829e56-167e-4b54-83cb-eeefb1470dfe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.988144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872b80d8f161486ab774165084e4feca', 'request_id': 'req-49829e56-167e-4b54-83cb-eeefb1470dfe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:56.997534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872b80d8f161486ab774165084e4feca', 'request_id': 'req-49829e56-167e-4b54-83cb-eeefb1470dfe'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:57.114983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] The token cache is being invalidate because project 872b80d8f161486ab774165084e4feca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:26:57.115372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:57.116103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-49829e56-167e-4b54-83cb-eeefb1470dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:26:57.117654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1217/2432] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:26:56 2022] DELETE /identity/v3/projects/872b80d8f161486ab774165084e4feca => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:57.123277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.123830 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.123967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.148275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:57.155819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:57.254396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1216/2433] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:57.263834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.264130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.264411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.290011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:57.292145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:57.300379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1218/2434] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:57.304894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:57.317405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4021b8-9ecc-4f7f-8d71-bf754f26034f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:57.323970 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:57.324574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.324864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.325137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.325828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:26:57.326152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:57.354510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:57.369503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1217/2435] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:26:57.374152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:57.385780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb238c-2761-44ab-9a11-03fc507d0d25 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:57.391316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:57.391563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.391883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.392238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.392877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:57.420724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:57.544948 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1219/2436] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:26:57 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:57.547054 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:57.559103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf41f-d5f0-495b-8f57-559699a2f504 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:57.671129 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:57.671596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.672189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.672189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.672792 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:57.714592 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:57.795377 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1218/2437] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:26:57 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:26:57.799265 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:57.810649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737f2b9-86df-4644-bcf8-87e23290e5b9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:57.815561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:57.816239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.816641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.817014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.817771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:57.844183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aeef0-6247-4234-8bf8-c8b4ebb28fa8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:57.861358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1220/2438] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:26:57.866206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:57.879554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188898-c9ba-4b87-832e-e8bdd353b747 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:57.887836 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:57.889604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:57.890290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:57.890849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] PATH_INFO: `/v3/projects/f2725b638eac48ceac28f1cc69b012a7/users/1b02adf314c249919aea268ea68e6370/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:57.935312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2725b638eac48ceac28f1cc69b012a7, user_id=1b02adf314c249919aea268ea68e6370, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:58.003873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:58.119780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1219/2439] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:26:57 2022] PUT /identity/v3/projects/f2725b638eac48ceac28f1cc69b012a7/users/1b02adf314c249919aea268ea68e6370/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:26:58.124455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:58.124747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:58.125021 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:58.148774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:26:58.150743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:58.236844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1221/2440] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:26:58.252870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:26:58.255804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:26:58.333503 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f99b2-5b6a-4ff3-b2e9-037e7b752686 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:26:58.339378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:26:58.340058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:26:58.340358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:26:58.340644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:26:58.350901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:26:58.389573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5e11-c7f3-4990-ad4a-9db7612a1979 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:26:58.402941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1220/2441] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:26:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:01.014657 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:01.031351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20a3ad-3310-441f-9673-b07ad9e67ee0 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:01.043528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:01.044479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.045180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.045675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.048110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:01.072984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:01.078979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.079452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.079943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.113552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:01.136016 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1222/2442] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:01.149071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] MFA Rules not processed for user `1b02adf314c249919aea268ea68e6370`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:01.151695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:01.292942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1221/2443] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:01.297599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:01.319861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17325cc-1dd8-4d69-ba6b-73b6f1c8ddfa service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:01.329004 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:01.331150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.331752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.333198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.334236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:01.368849 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:01.469233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1223/2444] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:01 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:01.470859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:01.497893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440f1f-c746-461c-9a11-6941c0f6b096 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:01.612528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:01.613524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.614040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.614338 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.615730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:01.648170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:01.809525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1222/2445] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:01 2022] POST /identity/v3/users => generated 309 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:01.814476 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:01.826188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31180f-a31a-46ba-8e47-42376b13a394 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:01.831283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:01.832399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.832850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.833289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.834189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:01.878649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:01.884583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1224/2446] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:01.886014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:01.896801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2a8c-de08-4680-8401-8715315d63e4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:01.902667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:01.903686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:01.904147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:01.904536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] PATH_INFO: `/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:01.946809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88e5901b2e4d1bb626bf2b2f1d36f0, user_id=20902e0b03be4574a8acedbef25bf1e7, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:01.984545 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:02.115355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1223/2447] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:01 2022] PUT /identity/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:02.119609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:02.130060 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63591-87b6-4233-838b-414db528591f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:02.210201 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:02.211065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:02.211341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:02.212516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:02.213521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:02.247402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:02.268705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1225/2448] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:02.273443 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:02.288447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cd8e-b9d3-4e98-8347-158fdeccbf39 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:02.295976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:02.297499 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:02.298019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:02.298453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] PATH_INFO: `/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:02.301325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88e5901b2e4d1bb626bf2b2f1d36f0, user_id=20902e0b03be4574a8acedbef25bf1e7, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:02.332547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:02.350608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1224/2449] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:02 2022] PUT /identity/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:02.356653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:02.366981 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75c07b-07c4-473a-87af-a1192abb3232 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:02.459640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:02.460593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:02.460986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:02.461392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:02.463100 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:02.492590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:02.504782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1226/2450] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:02.509274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:02.528058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824be3e-28ea-42b1-9459-e32a5d5c5979 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:02.543047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:02.543957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:02.544298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:02.544581 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] PATH_INFO: `/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:02.546782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88e5901b2e4d1bb626bf2b2f1d36f0, user_id=20902e0b03be4574a8acedbef25bf1e7, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:02.575911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1d56c-18b5-44b9-ac90-2db19d1cd374 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:02.694585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1225/2451] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:02 2022] PUT /identity/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0/users/20902e0b03be4574a8acedbef25bf1e7/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:03.331524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:03.333251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:03.348182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104240a4-1291-4cc8-b5b2-ecc84600eaff admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:03.479145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:03.482541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:03.483705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:03.484393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] PATH_INFO: `/v3/users/4fa22f12adb946c28c27e6ad6df8c311` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:03.487344 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa22f12adb946c28c27e6ad6df8c311)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:03.546015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:03.792535 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa22f12adb946c28c27e6ad6df8c311'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:03.807226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa22f12adb946c28c27e6ad6df8c311'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:03.898085 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa22f12adb946c28c27e6ad6df8c311'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:03.914953 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa22f12adb946c28c27e6ad6df8c311'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:03.916473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa22f12adb946c28c27e6ad6df8c311'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:03.925173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1227/2452] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:03 2022] DELETE /identity/v3/users/4fa22f12adb946c28c27e6ad6df8c311 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:03.929924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aecc3-369f-49a3-be3a-a110d6603660 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:03.930572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aecc3-369f-49a3-be3a-a110d6603660 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:03.931081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aecc3-369f-49a3-be3a-a110d6603660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:03.956460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-166aecc3-369f-49a3-be3a-a110d6603660 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:03.958378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-166aecc3-369f-49a3-be3a-a110d6603660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:04.051804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1226/2453] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:04.071759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:04.074312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:04.164481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937cce-ff76-450f-a0b4-7c34b2c5a1a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:04.168890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:04.169493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:04.169828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:04.170135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:04.182722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:04.210028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:04.221242 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1228/2454] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:04.815657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:04.815994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:04.816253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:04.862650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] MFA Rules not processed for user `20902e0b03be4574a8acedbef25bf1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:04.864917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:04.986957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1227/2455] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:04 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:05.092854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:05.094243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:05.115921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770b4f1-51d0-4180-b4d5-7be4b2ba2b8f service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:05.127289 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:05.128132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:05.128583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:05.128901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] PATH_INFO: `/v3/projects/861190128d3b4754987632500ec26488` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:05.132417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861190128d3b4754987632500ec26488)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:05.186750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:05.383453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861190128d3b4754987632500ec26488', 'request_id': 'req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.413638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861190128d3b4754987632500ec26488', 'request_id': 'req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.433394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861190128d3b4754987632500ec26488', 'request_id': 'req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.531357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] The token cache is being invalidate because project 861190128d3b4754987632500ec26488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:05.531640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.532286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.534063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1229/2456] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:05 2022] DELETE /identity/v3/projects/861190128d3b4754987632500ec26488 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:05.540869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:05.554413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c917bd-78db-4ba9-9a94-a9e2ad9323ec None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:05.650547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:05.652209 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:05.652769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:05.653388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] PATH_INFO: `/v3/users/3107677d277742fc81a904e921a49179` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:05.655518 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3107677d277742fc81a904e921a49179)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:05.691171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:05.898411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3107677d277742fc81a904e921a49179'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.972926 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3107677d277742fc81a904e921a49179'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:05.984770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3107677d277742fc81a904e921a49179'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:06.004498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3107677d277742fc81a904e921a49179'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:06.005714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f094b7aa-12e7-4d0e-bf98-80341c3a577f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3107677d277742fc81a904e921a49179'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:06.017519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1228/2457] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:05 2022] DELETE /identity/v3/users/3107677d277742fc81a904e921a49179 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:06.697130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:06.699732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:06.718819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df54868-e1f7-4f5f-b994-eda12e5eb4f5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:06.802551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:06.803864 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:06.804005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:06.804417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] PATH_INFO: `/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:06.806740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bbdfce46cb4ff09028d705b1bfcc74)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:06.836276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:06.980768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bbdfce46cb4ff09028d705b1bfcc74', 'request_id': 'req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:07.006252 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bbdfce46cb4ff09028d705b1bfcc74', 'request_id': 'req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:07.013030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bbdfce46cb4ff09028d705b1bfcc74', 'request_id': 'req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:07.120964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] The token cache is being invalidate because project c8bbdfce46cb4ff09028d705b1bfcc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:07.121315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:07.121910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-f38110b8-ca05-4023-be4d-ffc1cc5c7fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:07.123626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1230/2458] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:06 2022] DELETE /identity/v3/projects/c8bbdfce46cb4ff09028d705b1bfcc74 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:07.129293 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.130453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.131081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.158880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:07.160145 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:07.252000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1229/2459] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:07.260211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.260536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.260824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.286074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:07.287249 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:07.294636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1231/2460] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:07.298898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:07.308526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754531b-bb0a-4100-a89f-32451b36f48c None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:07.313957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:07.314493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.314776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.315058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.315762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:07.316064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:07.344536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:07.359146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1230/2461] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:07.364014 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:07.377041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78d51-be59-4061-ba88-c535a64e7549 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:07.382605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:07.397479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.401773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.402471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.407287 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:07.442729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:07.551550 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1232/2462] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:07 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:07.561387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:07.569183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4e7f-149e-4dbc-b38d-a6aa514149bb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:07.653071 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:07.653811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.654178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.654514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.655227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:07.693060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:07.801104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1231/2463] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:07 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:07.806055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:07.817296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f5cec-b6f6-4126-add3-10bbe5c93865 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:07.824011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:07.824635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.824923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.825202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.825975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:07.851878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616d1c5-a700-4101-8d5b-33457a5cc22d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:07.865266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1233/2464] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:07.869235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:07.880141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74170-9e74-42e3-9604-873ea54771e3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:07.895571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:07.896436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:07.896724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:07.897010 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] PATH_INFO: `/v3/projects/021ba6dfcca0482d9e5b7098d0a8565f/users/20be07c8ceaa4625a34a1df844d89850/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:07.925512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021ba6dfcca0482d9e5b7098d0a8565f, user_id=20be07c8ceaa4625a34a1df844d89850, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:07.955128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.044180 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1232/2465] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:07 2022] PUT /identity/v3/projects/021ba6dfcca0482d9e5b7098d0a8565f/users/20be07c8ceaa4625a34a1df844d89850/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:08.046358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.046745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.047033 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.094951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] MFA Rules not processed for user `20be07c8ceaa4625a34a1df844d89850`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:08.096899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:08.188798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1234/2466] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:08.194406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:08.278882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2608-0a57-4dfc-a20b-b085ecd3ee75 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:08.283537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:08.284435 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.284790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.285105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.285762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:08.312824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.460700 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1233/2467] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:08 2022] POST /identity/v3/projects => generated 369 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:08.465837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:08.484247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf231a8-6951-4503-8a60-7990b9f7b00d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:08.574912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:08.576797 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:08.585706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:08.585706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.585706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.585706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.586178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:08.598105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd7ddb-6f10-43cc-823b-69de78758022 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:08.611969 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.617175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:08.618698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.618698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.618698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] PATH_INFO: `/v3/users/1b02adf314c249919aea268ea68e6370` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.621283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b02adf314c249919aea268ea68e6370)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:08.650339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.724609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1235/2468] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:08 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:08.725809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:08.748909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a31633-0621-4c62-95b8-3f9ac6d3cc42 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:08.757394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:08.757394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.757394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.757394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.757800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:08.797246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.809199 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1236/2469] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:08.814838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:08.833375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69748-37c8-4253-9023-5f9846a085a6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:08.840250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:08.841358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:08.841826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:08.842329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] PATH_INFO: `/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:08.867467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc00715189574a7ea723ca2d4232c12b, user_id=baafd33c1c0e4e37b939f04dccf3bca7, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:08.896846 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:08.925183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b02adf314c249919aea268ea68e6370'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.002468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1237/2470] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:08 2022] PUT /identity/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:09.004325 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.017872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b02adf314c249919aea268ea68e6370'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.029067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b02adf314c249919aea268ea68e6370'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.044636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b02adf314c249919aea268ea68e6370'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.045506 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b02adf314c249919aea268ea68e6370'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.053408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1234/2471] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:08 2022] DELETE /identity/v3/users/1b02adf314c249919aea268ea68e6370 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:09.148958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e3ae-f309-444c-abfe-922feaaf1168 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:09.243984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:09.244724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.245088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.245504 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.246243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:09.277338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:09.294410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1238/2472] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:09.295278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.300921 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:09.317195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b577e-d885-49a3-9ada-b00ff8779b51 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:09.324131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:09.325220 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.325754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.326273 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] PATH_INFO: `/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.329623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc00715189574a7ea723ca2d4232c12b, user_id=baafd33c1c0e4e37b939f04dccf3bca7, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:09.360451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:09.373043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1235/2473] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:09 2022] PUT /identity/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:09.380184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.408683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811fced-9671-4f73-bbc6-6a1b3e0abfa3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:09.446335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.454012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:09.518377 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:09.519264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.519649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.520089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.521192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:09.567900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:09.595424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e342-1697-42d9-a923-8a7e3f827f19 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:09.599940 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1239/2474] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:09.600713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.603633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:09.604508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.604830 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.605628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] PATH_INFO: `/v3/projects/f2725b638eac48ceac28f1cc69b012a7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.606899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2725b638eac48ceac28f1cc69b012a7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:09.613823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f11479-5270-42a0-aeb7-a2197890aec8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:09.621830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:09.623310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.623604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.623890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] PATH_INFO: `/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.626306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc00715189574a7ea723ca2d4232c12b, user_id=baafd33c1c0e4e37b939f04dccf3bca7, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:09.637461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:09.665324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810c86-9f5e-46a2-bef5-63d96327b59e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:09.767640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1240/2475] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:09 2022] PUT /identity/v3/projects/dc00715189574a7ea723ca2d4232c12b/users/baafd33c1c0e4e37b939f04dccf3bca7/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:09.778891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728fa6-15c7-4090-a934-781d83834847 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:09.779186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728fa6-15c7-4090-a934-781d83834847 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:09.779467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728fa6-15c7-4090-a934-781d83834847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:09.839321 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2725b638eac48ceac28f1cc69b012a7', 'request_id': 'req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.913392 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-36728fa6-15c7-4090-a934-781d83834847 None None] MFA Rules not processed for user `baafd33c1c0e4e37b939f04dccf3bca7`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:09.915434 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-36728fa6-15c7-4090-a934-781d83834847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:09.926026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2725b638eac48ceac28f1cc69b012a7', 'request_id': 'req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.940800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2725b638eac48ceac28f1cc69b012a7', 'request_id': 'req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.956782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] The token cache is being invalidate because project f2725b638eac48ceac28f1cc69b012a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:09.957225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.967060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:09.969009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1236/2476] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:09 2022] DELETE /identity/v3/projects/f2725b638eac48ceac28f1cc69b012a7 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:09.973050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:09.976602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:10.019820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1241/2477] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:10.031393 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36728fa6-15c7-4090-a934-781d83834847 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:10.032702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-36728fa6-15c7-4090-a934-781d83834847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:10.075632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27cbf-7f6a-481c-b44b-c464b4e85ede admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:10.075632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:10.075632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:10.076065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:10.076065 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] PATH_INFO: `/v3/users/20902e0b03be4574a8acedbef25bf1e7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:10.077785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20902e0b03be4574a8acedbef25bf1e7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:10.108436 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:10.127008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36728fa6-15c7-4090-a934-781d83834847 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:10.134107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:10.135483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:10.136257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:10.136715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:10.151370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:10.180485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:10.190453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1242/2478] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:10 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:10.192418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:10.194034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:10.209762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5f1b-0b3b-4f16-9d92-e17c664a7695 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:10.215355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:10.216247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:10.216537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:10.216817 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] PATH_INFO: `/v3/users/afef28a167e84f26a8bd5ef64a124ce9` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:10.218010 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afef28a167e84f26a8bd5ef64a124ce9)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:10.245381 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:10.322582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20902e0b03be4574a8acedbef25bf1e7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.395038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20902e0b03be4574a8acedbef25bf1e7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.407431 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20902e0b03be4574a8acedbef25bf1e7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.426216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20902e0b03be4574a8acedbef25bf1e7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.431664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20902e0b03be4574a8acedbef25bf1e7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.436824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1237/2479] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:09 2022] DELETE /identity/v3/users/20902e0b03be4574a8acedbef25bf1e7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:10.437653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:10.441539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:10.491101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afef28a167e84f26a8bd5ef64a124ce9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.502149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afef28a167e84f26a8bd5ef64a124ce9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.556841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51d48-9861-4d23-9082-4ac18878d786 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:10.566484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:10.567105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:10.567427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:10.567715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:10.569620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:10.585038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afef28a167e84f26a8bd5ef64a124ce9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.620212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afef28a167e84f26a8bd5ef64a124ce9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.621370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afef28a167e84f26a8bd5ef64a124ce9'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:10.635536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1243/2480] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:10 2022] DELETE /identity/v3/users/afef28a167e84f26a8bd5ef64a124ce9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:10.674888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:10.705178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:10.719623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1238/2481] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:10 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:11.024579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.026672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.081238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.083262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.128173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1347f6-39aa-49a6-b352-0351172c0a84 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.132752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.134585 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.134986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.135335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] PATH_INFO: `/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.136586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be88e5901b2e4d1bb626bf2b2f1d36f0)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.166072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.197107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc1ed-50a6-4a40-a0fc-e3252d91337b service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.202352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.203287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.203644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.203992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] PATH_INFO: `/v3/projects/6fa59c85afb44ed2b62b06378c5fba49` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.205141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa59c85afb44ed2b62b06378c5fba49)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.234924 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.296780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be88e5901b2e4d1bb626bf2b2f1d36f0', 'request_id': 'req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.311654 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be88e5901b2e4d1bb626bf2b2f1d36f0', 'request_id': 'req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.317386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be88e5901b2e4d1bb626bf2b2f1d36f0', 'request_id': 'req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.435659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa59c85afb44ed2b62b06378c5fba49', 'request_id': 'req-5133aff2-6e2e-4021-8406-b0c2f2a805f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.456721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] The token cache is being invalidate because project be88e5901b2e4d1bb626bf2b2f1d36f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:11.457220 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.458684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2fb61e4d-ab8e-4f25-ab05-662283d98a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.460641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1244/2482] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:11 2022] DELETE /identity/v3/projects/be88e5901b2e4d1bb626bf2b2f1d36f0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:11.469005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.469552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.470067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.499000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:11.500267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.549284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa59c85afb44ed2b62b06378c5fba49', 'request_id': 'req-5133aff2-6e2e-4021-8406-b0c2f2a805f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.563096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa59c85afb44ed2b62b06378c5fba49', 'request_id': 'req-5133aff2-6e2e-4021-8406-b0c2f2a805f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.574498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] The token cache is being invalidate because project 6fa59c85afb44ed2b62b06378c5fba49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:11.574819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.575977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-5133aff2-6e2e-4021-8406-b0c2f2a805f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:11.577986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1239/2483] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:11 2022] DELETE /identity/v3/projects/6fa59c85afb44ed2b62b06378c5fba49 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:11.590761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0861-2cc1-442b-a67c-c9f092c3f003 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.591101 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0861-2cc1-442b-a67c-c9f092c3f003 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.591358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0861-2cc1-442b-a67c-c9f092c3f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.614794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1245/2484] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:11.614794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.617329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.630742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f83a0861-2cc1-442b-a67c-c9f092c3f003 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:11.632547 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f83a0861-2cc1-442b-a67c-c9f092c3f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.646467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1240/2485] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:11.648473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362fb15-2c6a-4df4-96d1-9d94a867bafa None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.649509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362fb15-2c6a-4df4-96d1-9d94a867bafa None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.656112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362fb15-2c6a-4df4-96d1-9d94a867bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.685262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4362fb15-2c6a-4df4-96d1-9d94a867bafa None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:11.686472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4362fb15-2c6a-4df4-96d1-9d94a867bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.697827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1241/2486] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:11.699166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.699460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.699742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.718317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957bbae-a241-4246-80c6-95dc42254f69 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.721991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.722598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.722887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.723166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.725065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.731451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:11.733239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:11.743441 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1242/2487] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:11.744640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.756732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8940cb-4c58-4eb7-94d0-120653b5489a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.762680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.763284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.763628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.763916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.764703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:11.765001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.791998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.803264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.811562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1243/2488] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:11.811562 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.823052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb714947-099e-4a71-a535-cfc1aa3e5bcb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.827992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.829172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.829350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.829527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.829527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.830745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:11.831367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.839596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1246/2489] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:11 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:11.840446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.867279 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.869755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6dfd-e676-438b-b14e-7a500dda6e18 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.877789 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.879114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.879410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.879692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.881186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.886341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1244/2490] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:11.890952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:11.903149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d378f-f237-496a-8f64-e05f70374b7a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:11.908014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:11.908617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:11.909063 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:11.909356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:11.910236 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:11.915283 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:11.940451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.030123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1247/2491] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:12.034822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.054215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1245/2492] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:11 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:12.055682 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.148809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe511e-cbec-4500-bbeb-db25aaf5b005 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.154613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.155454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.155826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.156204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.156949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.157670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cd27e-495c-4c23-bd1b-def89dbe0c86 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.165043 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.165893 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.166565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.166856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.167740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.193401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.200870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.596331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1248/2493] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:12 2022] POST /identity/v3/users => generated 282 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:12.600471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.612048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac032-7b18-4a0f-a239-035104b12964 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.624827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.625903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.625903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.626234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.627046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.655227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.666966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1249/2494] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:12.671489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.677971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1246/2495] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:12 2022] POST /identity/v3/users => generated 284 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:12.683117 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77270878-63eb-4b0c-8349-d875217ff27f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.685986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.687773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.688706 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.689058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.689400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] PATH_INFO: `/v3/projects/4cf5beea05874f588fa6d89ffbd89249/users/fa249f93ea5c4b37a95934293ecd3e92/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.697109 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384586-1d68-4a36-9c78-688fa00af5b8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.704105 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.705268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.705815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.706322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.718922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf5beea05874f588fa6d89ffbd89249, user_id=fa249f93ea5c4b37a95934293ecd3e92, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.719517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.747231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d32e6-e847-44af-9e5d-f0444bde1554 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.760842 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.776251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1247/2496] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:12.777337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:12.791360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3e5a-c23c-4b07-8d7a-82acda451e7f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:12.796197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:12.796993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.797284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.797575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] PATH_INFO: `/v3/projects/39cc2927b63d400194a339f92a758ce3/users/8b1a3004c384416c9b2354e547406803/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.823336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cc2927b63d400194a339f92a758ce3, user_id=8b1a3004c384416c9b2354e547406803, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:12.838913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1250/2497] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:12 2022] PUT /identity/v3/projects/4cf5beea05874f588fa6d89ffbd89249/users/fa249f93ea5c4b37a95934293ecd3e92/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:12.850518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.856481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.856481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:12.861806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b7112-79eb-40e8-b5c9-7829edbe91ef admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:12.899352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] MFA Rules not processed for user `fa249f93ea5c4b37a95934293ecd3e92`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:12.900529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:12.968028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1248/2498] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:12 2022] PUT /identity/v3/projects/39cc2927b63d400194a339f92a758ce3/users/8b1a3004c384416c9b2354e547406803/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:12.974960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:12.975374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:12.975724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.019294 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1251/2499] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:13.023777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.032227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] MFA Rules not processed for user `8b1a3004c384416c9b2354e547406803`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:13.033206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:13.127611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1249/2500] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:13.142175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.143559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:13.152351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1cd22-c733-4ed4-96d3-b71b72ee9c14 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.235197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30480f77-1852-41eb-b02b-ab05fb022790 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.242087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.243297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.243751 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.244218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.262366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:13.264656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.265232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.266026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.281183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.281183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:13.293365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:13.301317 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:13.309405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1250/2501] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:13.414966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1252/2502] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:13 2022] POST /identity/v3/projects => generated 365 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:13.416322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.427544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f037a-7ca8-4d04-bd83-2c3505dd6121 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.532763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.533356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.533648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.533966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.534621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:13.565238 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:13.644727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1251/2503] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:13 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:13.649012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.659616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae22a5-b04d-4b47-9a9b-780b4091a234 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.664107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.664760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.665046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.665327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.666183 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:13.691520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:13.704358 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1253/2504] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:13.708918 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.719102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b684d-0904-4dc4-8c56-36c789e28143 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.723452 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.724276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.724567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.724855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] PATH_INFO: `/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.747267 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c0f38d370b48e6b37e903247111ed5, user_id=e162617c3c584f8a8659fffce7d805c6, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:13.775907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:13.851051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1252/2505] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:13 2022] PUT /identity/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:13.856164 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:13.866477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a53b-fe7d-4472-b491-cacdd429326f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:13.960831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:13.962311 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:13.962670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:13.963073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:13.964441 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:14.010190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:14.034414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1254/2506] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:14.038308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:14.055161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655088e-9788-400f-af48-3bfdcc624b3b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:14.076957 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:14.077886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:14.078066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:14.078348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] PATH_INFO: `/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:14.080510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c0f38d370b48e6b37e903247111ed5, user_id=e162617c3c584f8a8659fffce7d805c6, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:14.112917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:14.132804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1253/2507] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:14 2022] PUT /identity/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:14.138731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:14.150098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec6e-5896-4319-a964-86269beb7a93 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:14.233887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:14.234638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:14.234880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:14.235382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:14.236109 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:14.264831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7b1b5-d4f2-4845-adc5-8970257ecc6c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:14.278207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1255/2508] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:14.282417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:14.295952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdad4a-42a2-47bf-8abb-ed0d6f43c1c5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:14.303327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:14.304708 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:14.305811 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:14.306322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] PATH_INFO: `/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:14.309287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c0f38d370b48e6b37e903247111ed5, user_id=e162617c3c584f8a8659fffce7d805c6, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:14.363939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:14.483173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1254/2509] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:14 2022] PUT /identity/v3/projects/d6c0f38d370b48e6b37e903247111ed5/users/e162617c3c584f8a8659fffce7d805c6/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:14.497015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:14.497539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:14.497921 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:14.553692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] MFA Rules not processed for user `e162617c3c584f8a8659fffce7d805c6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:14.556174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:14.667917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1256/2510] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:14 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:14.684859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:14.756122 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c271b-5a2a-4541-81aa-29d750e43e91 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:14.759765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:14.760497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:14.760789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:14.761075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:14.779257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:14.806538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:14.816540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1255/2511] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:14 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:15.085745 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:15.096646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070824-ff1b-450a-87b4-839910937c01 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:15.100234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:15.100861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:15.101146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:15.101426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:15.208092 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:15.238098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a73748-eba4-4949-8493-50e398fef027 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:15.248422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1257/2512] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:15 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:17.273300 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:17.276208 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:17.440808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37a873-f56b-4bf8-a1c9-3b7b68fcc58f service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:17.447533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:17.449200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:17.449356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:17.449787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] PATH_INFO: `/v3/users/20be07c8ceaa4625a34a1df844d89850` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:17.451308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20be07c8ceaa4625a34a1df844d89850)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:17.487886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:17.683683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20be07c8ceaa4625a34a1df844d89850'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:17.743326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20be07c8ceaa4625a34a1df844d89850'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:17.767449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20be07c8ceaa4625a34a1df844d89850'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:17.797100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20be07c8ceaa4625a34a1df844d89850'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:17.798615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20be07c8ceaa4625a34a1df844d89850'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:17.807039 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1256/2513] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:17 2022] DELETE /identity/v3/users/20be07c8ceaa4625a34a1df844d89850 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:17.811402 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:17.812270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:17.812589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:17.841874 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:17.843101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:17.932848 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1258/2514] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:17.943374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:17.946847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:18.042411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73501ce-efcf-4eea-bed1-85970eb3efd4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:18.045887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:18.047152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:18.047152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:18.047152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:18.057380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:18.083526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:18.094161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1257/2515] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:18.775527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:18.775527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:18.790738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae684-2a4b-4d0f-8eaf-c154e3944ef1 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:18.796013 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:18.798301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:18.798301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:18.798301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] PATH_INFO: `/v3/projects/021ba6dfcca0482d9e5b7098d0a8565f` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:18.799606 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021ba6dfcca0482d9e5b7098d0a8565f)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:18.828597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:18.964382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021ba6dfcca0482d9e5b7098d0a8565f', 'request_id': 'req-d7225c2c-af49-4ddd-936e-0400af949c40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:18.975964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021ba6dfcca0482d9e5b7098d0a8565f', 'request_id': 'req-d7225c2c-af49-4ddd-936e-0400af949c40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:18.987889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021ba6dfcca0482d9e5b7098d0a8565f', 'request_id': 'req-d7225c2c-af49-4ddd-936e-0400af949c40'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.154081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] The token cache is being invalidate because project 021ba6dfcca0482d9e5b7098d0a8565f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:19.154986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.154986 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d7225c2c-af49-4ddd-936e-0400af949c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.156526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1259/2516] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:18 2022] DELETE /identity/v3/projects/021ba6dfcca0482d9e5b7098d0a8565f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:19.160628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:19.175965 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526753-356f-4da7-8cb8-f67c78a4ae70 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:19.246498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:19.247223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:19.247513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:19.247796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] PATH_INFO: `/v3/users/baafd33c1c0e4e37b939f04dccf3bca7` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:19.248902 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baafd33c1c0e4e37b939f04dccf3bca7)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:19.275387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:19.533745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baafd33c1c0e4e37b939f04dccf3bca7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.612046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baafd33c1c0e4e37b939f04dccf3bca7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.621299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baafd33c1c0e4e37b939f04dccf3bca7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.636676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baafd33c1c0e4e37b939f04dccf3bca7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.637385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baafd33c1c0e4e37b939f04dccf3bca7'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:19.643961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1258/2517] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:19 2022] DELETE /identity/v3/users/baafd33c1c0e4e37b939f04dccf3bca7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:19.983988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:19.985621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:19.985621 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:20.032667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:20.034766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:20.137489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1260/2518] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:27:19 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:20.335397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:20.336953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:20.384992 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:20.389898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:20.450847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477252ed-d180-499b-9d64-702c2e574cf0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:20.458358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:20.458958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:20.459255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:20.459534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:20.472758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:20.475235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8e1d-5f60-4538-a52a-b613d964a978 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:20.479892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:20.480867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:20.481148 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:20.486297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] PATH_INFO: `/v3/projects/dc00715189574a7ea723ca2d4232c12b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:20.486297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc00715189574a7ea723ca2d4232c12b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:20.510793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:20.512801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed52c7-5a24-4a2a-913a-c45bea9c8b00 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:20.521563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1259/2519] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:27:20.665472 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc00715189574a7ea723ca2d4232c12b', 'request_id': 'req-27423304-2042-43bf-b76d-1d484b15954d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:20.676587 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc00715189574a7ea723ca2d4232c12b', 'request_id': 'req-27423304-2042-43bf-b76d-1d484b15954d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:20.684591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc00715189574a7ea723ca2d4232c12b', 'request_id': 'req-27423304-2042-43bf-b76d-1d484b15954d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:20.778811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] The token cache is being invalidate because project dc00715189574a7ea723ca2d4232c12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:20.783008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:20.783008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-27423304-2042-43bf-b76d-1d484b15954d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:20.783008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1261/2520] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:20 2022] DELETE /identity/v3/projects/dc00715189574a7ea723ca2d4232c12b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:20.788877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:20.789357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:20.789841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:20.819190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:20.821830 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:20.961611 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1260/2521] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:20.972056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:20.972595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:20.973026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.009161 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:21.010676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:21.024001 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1262/2522] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:21.029252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.041204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe26a36-5a1d-4e71-84e9-07641388d69d None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.046683 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.047387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.047765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.048096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.049517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:21.049517 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:21.078603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:21.093486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1261/2523] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:21.097979 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.108935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e679-a393-4652-aaa4-41d8d7d7b5e6 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.114318 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.114931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.115207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.115488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.116122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:21.144203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:21.228841 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1263/2524] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:21 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:21.233073 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.244182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9624e-473a-4afb-8cac-d9eafa98b2f0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.334376 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.336917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.336917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.336917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.336917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:21.377789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:21.464386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1262/2525] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:21 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:21.468877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.484403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e7d38-f51d-444c-acc9-6c3dd801a72c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.492517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.492517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.492517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.492517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.492866 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:21.518008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881c59-19ef-4011-87fb-f62ca0c2e4e1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:21.530951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1264/2526] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:21.539966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.546798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aeb47-0119-4475-a427-21fdc7e4eb99 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.551225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.552050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.552343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.552630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] PATH_INFO: `/v3/projects/507b0ded3d0f467fa3cb886a156ade45/users/f268727760bb48bf9980eef14310ff0c/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.576089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507b0ded3d0f467fa3cb886a156ade45, user_id=f268727760bb48bf9980eef14310ff0c, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:21.603102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc868b-ddd9-4fcb-a930-df9bec658b22 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:21.685883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.686211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.686523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.711669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:21.712826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:21.725017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1263/2527] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:21 2022] PUT /identity/v3/projects/507b0ded3d0f467fa3cb886a156ade45/users/f268727760bb48bf9980eef14310ff0c/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:21.736050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.736352 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.736623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.780809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] MFA Rules not processed for user `f268727760bb48bf9980eef14310ff0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:21.782013 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:21.787129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1265/2528] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:21.801090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.802636 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:21.878381 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1264/2529] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:21.880082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:21.897873 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150c0a2-2e17-44c7-b3b3-0f7f97d0d602 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:21.992552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:21.993607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:21.994153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:21.994824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:21.998976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c2d3f-0b3f-45bc-86c4-3b3e6bbc6a73 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:22.006137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:22.006925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.009449 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.010005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.011394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.049953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab78a2-c151-433d-b3de-c7b443ac04e4 service swift] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1266/2530] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.226677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.229719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] MFA Rules not processed for user `af482d2941194468912f333c30e47d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:22.229719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:22.263313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1265/2531] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:21 2022] POST /identity/v3/projects => generated 393 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:22.263810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1267/2532] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:22.266053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:22.375250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076894-9c11-4583-a25b-54ff8891aa2e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:22.382491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:22.385223 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.385564 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.385840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.386521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.414181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.511501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1266/2533] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:22 2022] POST /identity/v3/users => generated 303 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:22.515743 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:22.528254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f8bbe-7cae-4d97-9212-33c885959a21 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:22.534154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:22.535189 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.535692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.536155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.537049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.566026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.582739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1268/2534] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:22.584858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:22.609570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5e4d-d4b1-4b55-9a5a-a888f361233d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:22.615264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:22.616667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.616667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.617412 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] PATH_INFO: `/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.668803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ff563b67994a1883c908330e643a2a, user_id=e242613ed545472c95c42ce5437a9a6d, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.701571 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.790160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1267/2535] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:22 2022] PUT /identity/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:22.796149 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:22.819486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb10135-7a76-4164-b766-da51da716c68 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:22.922963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:22.923581 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:22.923865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:22.924137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:22.924832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:22.964867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f5b93-fd53-4e51-a82c-095919ad68c9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:22.982614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1269/2536] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:22.987186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:23.008656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af959-7764-4399-8bbf-833ab61f3736 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:23.019558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:23.020625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.020910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.021193 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] PATH_INFO: `/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.035210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.035640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.036913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.046185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ff563b67994a1883c908330e643a2a, user_id=e242613ed545472c95c42ce5437a9a6d, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:23.077805 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:23.079372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:23.080727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:23.093530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1268/2537] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:22 2022] PUT /identity/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:23.098995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:23.182198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1270/2538] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:23.204632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:23.239967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd8b16-0712-4ea0-9c91-fe1c54cf6e99 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:23.255056 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:23.256152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.256508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.256802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.257714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:23.308718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab9a7-7095-4d16-9e83-cfe07787029d None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:23.323112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:23.374068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1269/2539] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:23.380218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:23.400410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90772-5bbc-4be7-a459-d8d5a271bba9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:23.406168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:23.407461 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.407752 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.408035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] PATH_INFO: `/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.409878 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ff563b67994a1883c908330e643a2a, user_id=e242613ed545472c95c42ce5437a9a6d, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:23.433425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:23.434501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.434878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.435246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.440224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7c680-df93-4278-9ad7-e62c678d6c2c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:23.544468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:23.548930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1270/2540] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:23 2022] PUT /identity/v3/projects/d5ff563b67994a1883c908330e643a2a/users/e242613ed545472c95c42ce5437a9a6d/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:23.559451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:23.559748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:23.560038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:23.592509 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:23.600960 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] MFA Rules not processed for user `e242613ed545472c95c42ce5437a9a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:23.602172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:23.606361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1271/2541] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:27:23.691846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1271/2542] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3767 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:23.871633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:23.873122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:23.960286 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c751310-0d59-4d5c-abb7-7e506e3731b1 service swift] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:24.026129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:24.026734 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:24.027026 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:24.027307 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:24.037154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:24.068198 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a59f5-65f1-479d-a4c1-ad99245f453a service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:24.080493 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1272/2543] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3767 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:24.145177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:24.156814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9cc9e-0313-4ff7-b375-cbaac982525f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:24.162590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:24.163390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:24.163834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:24.164225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:24.251488 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:24.278320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:24.289380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1272/2544] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:24.359285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:24.362483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:24.362483 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:24.387947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:24.389044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:24.489147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1273/2545] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:24.509390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:24.607680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a2e4-b8bd-49aa-8ec3-cca166eef00f service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:24.612444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:24.613057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:24.613361 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:24.613647 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:24.624275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:24.650123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d623-a7e1-456d-a70d-8f4a69702561 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:24.658710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1273/2546] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:27:28.396418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:28.397857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:28.494631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e9c4c-4160-47e7-babc-c700b4c18181 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:28.499264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:28.500129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:28.500418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:28.500956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] PATH_INFO: `/v3/users/8b1a3004c384416c9b2354e547406803` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:28.502170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1a3004c384416c9b2354e547406803)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:28.531836 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:28.824135 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1a3004c384416c9b2354e547406803'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:28.834209 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1a3004c384416c9b2354e547406803'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:28.925210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1a3004c384416c9b2354e547406803'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:28.942362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1a3004c384416c9b2354e547406803'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:28.943463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1a3004c384416c9b2354e547406803'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:28.951660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1274/2547] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:28 2022] DELETE /identity/v3/users/8b1a3004c384416c9b2354e547406803 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:28.956139 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:28.956709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:28.956709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:28.985916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:28.988006 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:29.093776 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1274/2548] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:29.109469 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:29.112801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:29.213315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c53086-47cf-49eb-8153-4762b6666174 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:29.217037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:29.217815 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:29.218141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:29.218427 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:29.229172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:29.255244 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:29.266051 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1275/2549] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:30.068972 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.072718 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.076333 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.077813 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.087319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f4d9-50c8-407d-8274-fb879491f16e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.090803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f1f8-a616-4e8f-946f-a9758a3567f5 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.092445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.093307 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.093593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.093859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] PATH_INFO: `/v3/users/e8cdeb95ec014c53887318b82f1e092d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.095024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cdeb95ec014c53887318b82f1e092d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.098369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.099808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.100371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.101295 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] PATH_INFO: `/v3/projects/39cc2927b63d400194a339f92a758ce3` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.103017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cc2927b63d400194a339f92a758ce3)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.127570 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:30.143702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:30.383967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cdeb95ec014c53887318b82f1e092d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.386096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cc2927b63d400194a339f92a758ce3', 'request_id': 'req-44c6cd5b-4250-42b6-94fc-514d3d62b778'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.398386 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cc2927b63d400194a339f92a758ce3', 'request_id': 'req-44c6cd5b-4250-42b6-94fc-514d3d62b778'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.404211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cc2927b63d400194a339f92a758ce3', 'request_id': 'req-44c6cd5b-4250-42b6-94fc-514d3d62b778'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.496917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cdeb95ec014c53887318b82f1e092d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.508249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cdeb95ec014c53887318b82f1e092d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.526262 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cdeb95ec014c53887318b82f1e092d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.527094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-536f4fc2-841f-4141-b5b9-b7ce3ada8893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cdeb95ec014c53887318b82f1e092d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.534870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1275/2550] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:30 2022] DELETE /identity/v3/users/e8cdeb95ec014c53887318b82f1e092d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:30.540594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.541182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.541618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.569068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:30.571356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.631050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] The token cache is being invalidate because project 39cc2927b63d400194a339f92a758ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:30.631904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.633616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-44c6cd5b-4250-42b6-94fc-514d3d62b778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:30.636070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1276/2551] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:30 2022] DELETE /identity/v3/projects/39cc2927b63d400194a339f92a758ce3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:30.645489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76c0e-fc69-4d39-9077-08f2fcce0b4d None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.645489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76c0e-fc69-4d39-9077-08f2fcce0b4d None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.645489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76c0e-fc69-4d39-9077-08f2fcce0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.653780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1276/2552] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:30.667040 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.668739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.671594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a4c76c0e-fc69-4d39-9077-08f2fcce0b4d None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:30.672756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a4c76c0e-fc69-4d39-9077-08f2fcce0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.683110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1277/2553] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:30.691077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.691373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.691659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.719449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:30.724192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.737804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1278/2554] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:30.743236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.762524 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e81738-8d0c-4e0e-938a-90ccf035eb68 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.769278 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.769903 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.770285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.770556 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.771426 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:30.771758 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.800466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:30.814596 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da2a4-87d9-40fd-8b93-344812bdd52b None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.819382 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1279/2555] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:30.821024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.822690 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.823818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.824291 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.824585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.831455 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:30.853144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.859840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae7a0-8051-441f-b646-0263d31a7931 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.865036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.865858 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.866182 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.866466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] PATH_INFO: `/v3/users/f268727760bb48bf9980eef14310ff0c` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.868881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f268727760bb48bf9980eef14310ff0c)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.878815 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:30.893023 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1277/2556] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:30.910171 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:30.914306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:30.924513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d31be2-60e4-4cbc-b909-8f34c986fe0c service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:30.930378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:30.930993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:30.931423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:30.931727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:30.932380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:30.968475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.139536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1278/2557] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:30 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:31.144616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:31.214276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f268727760bb48bf9980eef14310ff0c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.223705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f268727760bb48bf9980eef14310ff0c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.238820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47dd-f2b2-479e-b8cc-8c58e32f7d73 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:31.244428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:31.245197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.253165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.253165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.253165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:31.277554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.308823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f268727760bb48bf9980eef14310ff0c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.322620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f268727760bb48bf9980eef14310ff0c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.323308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d9a7a83e-cc42-43bd-a8aa-3dd5667b47d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f268727760bb48bf9980eef14310ff0c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.329604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1280/2558] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:30 2022] DELETE /identity/v3/users/f268727760bb48bf9980eef14310ff0c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:31.334423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.334721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.335006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.362300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:31.363713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:31.423539 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1279/2559] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:31 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:31.424721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:31.426278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:31.440035 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cfe71-e9ac-44cd-9989-620fa9e25202 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:31.452597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1281/2560] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:31.452597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:31.452597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:31.466168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160d5f1-348e-4d54-8bfc-6207c1d64d19 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:31.471171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:31.472202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.472669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.473121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.474230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:31.502868 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.514354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1282/2561] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:31.515539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:31.517614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:31.529505 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:31.531150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.531858 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.532710 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] PATH_INFO: `/v3/projects/492a540ce68041ba95947bda771f2b12` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.534825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] RBAC: Authorizing `identity:delete_project(project_id=492a540ce68041ba95947bda771f2b12)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:31.567260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.613451 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585a430-f351-48c0-b1b0-37d307f9bfc4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:31.622346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:31.622983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.623280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.623569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.634727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:31.661470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.673127 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1283/2562] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:31.674064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:31.685011 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5c3c-797d-4cb3-a4f8-bd5c647f8a5f service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:31.689786 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:31.690652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.690928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.691226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] PATH_INFO: `/v3/projects/4f0b2e1ef43246e9bba4d09637fb1363/users/7e237c1d4c1c4417a3f7686c8fd56632/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.714206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0b2e1ef43246e9bba4d09637fb1363, user_id=7e237c1d4c1c4417a3f7686c8fd56632, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:31.716861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492a540ce68041ba95947bda771f2b12', 'request_id': 'req-feaf175a-a2d7-4f75-84a6-aecc3d87377a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.741245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:31.816743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492a540ce68041ba95947bda771f2b12', 'request_id': 'req-feaf175a-a2d7-4f75-84a6-aecc3d87377a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.829497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492a540ce68041ba95947bda771f2b12', 'request_id': 'req-feaf175a-a2d7-4f75-84a6-aecc3d87377a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.840917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] The token cache is being invalidate because project 492a540ce68041ba95947bda771f2b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:31.841194 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.841962 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-feaf175a-a2d7-4f75-84a6-aecc3d87377a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:31.843397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1280/2563] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:31 2022] DELETE /identity/v3/projects/492a540ce68041ba95947bda771f2b12 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:31.862119 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1284/2564] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:31 2022] PUT /identity/v3/projects/4f0b2e1ef43246e9bba4d09637fb1363/users/7e237c1d4c1c4417a3f7686c8fd56632/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:31.880306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:31.880917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:31.881204 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:31.931877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] MFA Rules not processed for user `7e237c1d4c1c4417a3f7686c8fd56632`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:31.933850 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:32.138091 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1281/2565] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:32.144852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:32.147527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:32.268963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455521d-b1cc-4192-9ce8-95a6e0db1ef3 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:32.274506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:32.275203 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:32.275397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:32.275676 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:32.276321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:32.302558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:32.405984 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:32.407365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:32.430207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1285/2566] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:32 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:32.430652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f0200-d13e-43aa-aefe-1ea27e9dd49a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:32.432094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:32.504405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:32.505251 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:32.505568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:32.505849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] PATH_INFO: `/v3/projects/507b0ded3d0f467fa3cb886a156ade45` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:32.507147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=507b0ded3d0f467fa3cb886a156ade45)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:32.511316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ee8d-54df-46a2-9fd6-56352368af56 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:32.517300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:32.517924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:32.518243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:32.518533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:32.519174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:32.533800 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:32.547074 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:32.668929 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1286/2567] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:32 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:32.669762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:32.672952 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:32.685555 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc91aa-166b-4ea3-b89c-13ec1111a2cb admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:32.693510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:32.693510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:32.693510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:32.693510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] PATH_INFO: `/v3/users/fa249f93ea5c4b37a95934293ecd3e92` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:32.694108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa249f93ea5c4b37a95934293ecd3e92)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:32.722794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:32.790584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507b0ded3d0f467fa3cb886a156ade45', 'request_id': 'req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.902702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507b0ded3d0f467fa3cb886a156ade45', 'request_id': 'req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.915024 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507b0ded3d0f467fa3cb886a156ade45', 'request_id': 'req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.930686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] The token cache is being invalidate because project 507b0ded3d0f467fa3cb886a156ade45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:32.931092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.931925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.934941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1282/2568] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:32 2022] DELETE /identity/v3/projects/507b0ded3d0f467fa3cb886a156ade45 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:32.936253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:32.938289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:32.977565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa249f93ea5c4b37a95934293ecd3e92'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:32.988061 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa249f93ea5c4b37a95934293ecd3e92'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.046196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6f8c-c8fb-45ab-8d4a-8268c1d83fbb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.050643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.051277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.051566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.051859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.052567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.079498 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.085803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa249f93ea5c4b37a95934293ecd3e92'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.093138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1283/2569] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:33.094064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.095715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.105577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa249f93ea5c4b37a95934293ecd3e92'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.106484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa249f93ea5c4b37a95934293ecd3e92'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.108106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2011-106c-4ea4-8604-5d40551af188 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.112457 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.113268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.113556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.113827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1287/2570] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:32 2022] DELETE /identity/v3/users/fa249f93ea5c4b37a95934293ecd3e92 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:33.113967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] PATH_INFO: `/v3/users/e242613ed545472c95c42ce5437a9a6d` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.115188 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.117641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.120341 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e242613ed545472c95c42ce5437a9a6d)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.147134 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.196184 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7949-da3d-4d76-82fb-fa4d7ebbb445 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.200464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.201298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.201584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.201867 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] PATH_INFO: `/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.222262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d03363c73a4374a1d814bc38261f3a, user_id=5d6f8f0b4ed14d6fa9db3ba1cd6f33a8, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.250165 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38f26-3932-4dae-bdc3-ac33558aa0d5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.363037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1288/2571] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:33 2022] PUT /identity/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:33.363037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.363037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.363037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.386527 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:33.387669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.397111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e242613ed545472c95c42ce5437a9a6d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.460321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1289/2572] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:33.461714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.476299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b173-7051-4a68-a352-b01e40573aa9 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.478415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e242613ed545472c95c42ce5437a9a6d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.481543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.482362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.482630 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.482906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.483614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.489244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e242613ed545472c95c42ce5437a9a6d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.506455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e242613ed545472c95c42ce5437a9a6d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.507375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e242613ed545472c95c42ce5437a9a6d'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:33.510865 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.518485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1284/2573] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:33 2022] DELETE /identity/v3/users/e242613ed545472c95c42ce5437a9a6d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:33.519521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.523819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1290/2574] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:33.525706 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.526588 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.528762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.544123 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee471-62f0-4f8c-a533-849ce3b88b26 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.611383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cd50-2827-4469-b20e-4dd3eddc16d5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.615310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.615911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.621538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.621538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.621538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:33.629207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.630173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.630533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.630886 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] PATH_INFO: `/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.634146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d03363c73a4374a1d814bc38261f3a, user_id=5d6f8f0b4ed14d6fa9db3ba1cd6f33a8, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.662487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.674595 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1291/2575] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:33 2022] PUT /identity/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:33.679558 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.721894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.747977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.759510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe7b8-5a30-4867-a743-f69b89618763 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.759923 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1285/2576] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:33.764214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.764872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.765163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.765450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.766202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.791999 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffff1-b053-461e-a665-1d5e60286ad8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.803686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1292/2577] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:33.810603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:33.825169 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880aedb-1de5-4d3c-aa90-aed8a67849bb service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:33.832253 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:33.833758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.834212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.835296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] PATH_INFO: `/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:33.837603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d03363c73a4374a1d814bc38261f3a, user_id=5d6f8f0b4ed14d6fa9db3ba1cd6f33a8, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:33.866070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:33.948749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1286/2578] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:33 2022] PUT /identity/v3/projects/e2d03363c73a4374a1d814bc38261f3a/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:33.962374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:33.963159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:33.963452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.009104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] MFA Rules not processed for user `5d6f8f0b4ed14d6fa9db3ba1cd6f33a8`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:34.010429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.107834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1293/2579] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:34.118189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.120410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.199848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc91ac-4a8b-49ef-9828-a71822df1b0b admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.204116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.204866 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.205254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.205628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.216526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.241994 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:34.254130 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1287/2580] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:34 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:34.292500 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.295367 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.381762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc272-eea4-4a56-b7f3-15ccd5817198 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.386897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.387707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.387988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.388297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] PATH_INFO: `/v3/projects/d5ff563b67994a1883c908330e643a2a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.389416 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ff563b67994a1883c908330e643a2a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.415699 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:34.445854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.447995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.464062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7ebc-ed55-42e4-98ec-7370edd2f014 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.472976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.472976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.472976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.472976 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] PATH_INFO: `/v3/projects/4cf5beea05874f588fa6d89ffbd89249` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.473464 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf5beea05874f588fa6d89ffbd89249)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.497676 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:34.533390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ff563b67994a1883c908330e643a2a', 'request_id': 'req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.545658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ff563b67994a1883c908330e643a2a', 'request_id': 'req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.550839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ff563b67994a1883c908330e643a2a', 'request_id': 'req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.628297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] The token cache is being invalidate because project d5ff563b67994a1883c908330e643a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:34.628297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.628297 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-19eb32c8-f525-4f95-a0a3-8c5bfb746bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.631597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1294/2581] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:34 2022] DELETE /identity/v3/projects/d5ff563b67994a1883c908330e643a2a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:34.633599 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f773-6a58-4b5f-9ca9-1b0351f286d3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.633985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f773-6a58-4b5f-9ca9-1b0351f286d3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.634349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f773-6a58-4b5f-9ca9-1b0351f286d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.641246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf5beea05874f588fa6d89ffbd89249', 'request_id': 'req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.693658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4380f773-6a58-4b5f-9ca9-1b0351f286d3 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:34.695414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4380f773-6a58-4b5f-9ca9-1b0351f286d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.765173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf5beea05874f588fa6d89ffbd89249', 'request_id': 'req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.772512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1295/2582] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:34.779590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf5beea05874f588fa6d89ffbd89249', 'request_id': 'req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.783899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.784341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.784814 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.794309 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] The token cache is being invalidate because project 4cf5beea05874f588fa6d89ffbd89249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:34.794742 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.795600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:34.801971 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1288/2583] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:34 2022] DELETE /identity/v3/projects/4cf5beea05874f588fa6d89ffbd89249 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:34.803303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.805537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.822087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8a59d-70fa-4026-a46d-78b822c7aa9c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.826661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.832930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.832930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.832930 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] PATH_INFO: `/v3/users/e162617c3c584f8a8659fffce7d805c6` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.833605 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:34.833803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e162617c3c584f8a8659fffce7d805c6)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.834000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:34.845827 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1296/2584] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:34.846656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.868516 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efed6d-113c-47ab-b3fd-8e75362591c4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.872597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:34.872964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.874215 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.874566 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.875028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.876349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:34.876668 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.904653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:34.922759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1297/2585] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:34.927721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:34.939046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859146c-6706-4bb9-b762-b4cfdf9eeb75 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:34.944103 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:34.944810 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:34.947446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:34.947446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:34.947446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:34.973366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:35.064422 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e162617c3c584f8a8659fffce7d805c6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:35.130369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1298/2586] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:34 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:35.135303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:35.151656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e162617c3c584f8a8659fffce7d805c6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:35.165590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e162617c3c584f8a8659fffce7d805c6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:35.180998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e162617c3c584f8a8659fffce7d805c6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:35.181781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e162617c3c584f8a8659fffce7d805c6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:35.191258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1289/2587] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:34 2022] DELETE /identity/v3/users/e162617c3c584f8a8659fffce7d805c6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:35.215501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159dfe9-ba14-4520-99f0-c442fe077891 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:35.290389 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:35.291466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.292020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.292560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.293727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:35.345466 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:35.467787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1299/2588] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:35 2022] POST /identity/v3/users => generated 284 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:35.472255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:35.473831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:35.488494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e509f-4585-4a32-b600-99e114b86321 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:35.494367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:35.495264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.495774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.496256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.497176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:35.524667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e24e8a-283e-428c-a225-2c041633b913 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:35.540335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1290/2589] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:35.541684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:35.552406 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fab17-6fc7-45b7-bd27-6861fd41b370 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:35.557666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:35.558667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.560936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.560936 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] PATH_INFO: `/v3/projects/5fc6ff5919ee4a5face4a6c2620d34e1/users/b9b112aa308543fe8bbf39dcb00fa939/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.584720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc6ff5919ee4a5face4a6c2620d34e1, user_id=b9b112aa308543fe8bbf39dcb00fa939, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:35.619000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:35.720162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1300/2590] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:35 2022] PUT /identity/v3/projects/5fc6ff5919ee4a5face4a6c2620d34e1/users/b9b112aa308543fe8bbf39dcb00fa939/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:35.731326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.731623 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.732099 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.749762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:35.752528 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:35.777088 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] MFA Rules not processed for user `b9b112aa308543fe8bbf39dcb00fa939`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:35.782491 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:35.841613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169feaeb-669b-4bb0-8089-face8bf13170 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:35.848049 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:35.848967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.849419 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.849791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] PATH_INFO: `/v3/projects/d6c0f38d370b48e6b37e903247111ed5` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.851523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c0f38d370b48e6b37e903247111ed5)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:35.878192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:35.884798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1291/2591] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:35.888926 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:35.900448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08a3cb-813d-41e8-9da5-d2977cbd43f6 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:35.905047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:35.905723 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:35.906111 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:35.906454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:35.907277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:35.946780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.006733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c0f38d370b48e6b37e903247111ed5', 'request_id': 'req-03527a96-0325-49ba-b097-4489d747c33c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:36.020422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c0f38d370b48e6b37e903247111ed5', 'request_id': 'req-03527a96-0325-49ba-b097-4489d747c33c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:36.025890 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c0f38d370b48e6b37e903247111ed5', 'request_id': 'req-03527a96-0325-49ba-b097-4489d747c33c'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:36.064263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1292/2592] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:35 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:36.068366 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.146942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4bad-37f9-4800-9eed-f2bb8cdf4b9d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.156566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.157531 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.163701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.163701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.163701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.167620 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] The token cache is being invalidate because project d6c0f38d370b48e6b37e903247111ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:36.168110 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:36.168955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-03527a96-0325-49ba-b097-4489d747c33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:36.170975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1301/2593] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:35 2022] DELETE /identity/v3/projects/d6c0f38d370b48e6b37e903247111ed5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:36.177039 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efd9b-ec66-45dc-a4c7-7d004d638cbd None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.177324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efd9b-ec66-45dc-a4c7-7d004d638cbd None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.177607 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efd9b-ec66-45dc-a4c7-7d004d638cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.187773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.205644 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b82efd9b-ec66-45dc-a4c7-7d004d638cbd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:36.206844 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b82efd9b-ec66-45dc-a4c7-7d004d638cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:36.215008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1302/2594] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:36.222883 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.224439 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.224776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.249569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:36.251015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:36.259664 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1303/2595] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:36.264190 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.274984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4b83-09e6-46f2-91a7-dc45ee38f697 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.279762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.280409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.280889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.281178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.281902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:36.282235 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.309881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.324195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1293/2596] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:36 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:36.328659 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.332489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:36.332696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1304/2597] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:27:36.333272 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.347126 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063b201-ebaf-4147-a3df-a3b3cbe91e92 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.348509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e71f-c899-4456-a4f6-b2ec0f0991bd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.353223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.354101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.354331 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.354680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.355538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.356397 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.359721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.359721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.359721 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.360285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.388415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.392368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.400508 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1294/2598] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:36.405311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.422657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6337-f0ad-44a9-bca8-cf422bf4a103 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.427919 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.430450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.430450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.430729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] PATH_INFO: `/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.454558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26f7bf5551b42f494b5288653a3b74a, user_id=8e898ef350cf4c1ca0c407c513c45e44, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.483692 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.519111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1305/2599] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:36 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:36.524050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.567031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1295/2600] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:36 2022] PUT /identity/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:36.572702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.633373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0a83-4b43-4e62-81c3-01d911864352 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.672628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800e54-4d90-4bbf-9dce-065d44934c48 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.680442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.680442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.680442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.680442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.681261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.706911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.709313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.709460 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.709653 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.709961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.711151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.719061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1296/2601] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:36.725087 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.735649 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d64-4ce9-4c52-bafb-b8b62f3c3553 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.745751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.745891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.745891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.745891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.745891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] PATH_INFO: `/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.746312 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26f7bf5551b42f494b5288653a3b74a, user_id=8e898ef350cf4c1ca0c407c513c45e44, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.778124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.790278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1297/2602] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:36 2022] PUT /identity/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:36.794812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.826012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1306/2603] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:36 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:36.830479 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.841682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc36be-a896-487f-8c06-742c70272f23 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.873233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad19f-88c1-43dd-be59-c2659bc97b9d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.877898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.878492 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.878780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.879060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.879759 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.906286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.914316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.914316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.914316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.914316 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.914716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.919470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1298/2604] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:36.933744 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.944740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4a14-e7b8-4a78-92e3-afd77785b1a3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.945047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.949737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.950616 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.950901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.951455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] PATH_INFO: `/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:36.953859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26f7bf5551b42f494b5288653a3b74a, user_id=8e898ef350cf4c1ca0c407c513c45e44, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:36.958714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1307/2605] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:36.963696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:36.978359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5695-35fe-4db8-b4f6-1b37e7d68837 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:36.983803 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7400-a9e6-4885-a290-e6ef20992843 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:36.985067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:36.985902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:36.986306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:36.986514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] PATH_INFO: `/v3/projects/7b7343214d8e40849ec4b4ff31f9fdc3/users/7ca34f2703a544b9b4649333b3313ee6/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.011300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7343214d8e40849ec4b4ff31f9fdc3, user_id=7ca34f2703a544b9b4649333b3313ee6, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.040047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abc891-4990-4716-9195-69cf3fd054fb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.079730 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1299/2606] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:36 2022] PUT /identity/v3/projects/f26f7bf5551b42f494b5288653a3b74a/users/8e898ef350cf4c1ca0c407c513c45e44/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:37.094546 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.094998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.095393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.145225 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1308/2607] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:36 2022] PUT /identity/v3/projects/7b7343214d8e40849ec4b4ff31f9fdc3/users/7ca34f2703a544b9b4649333b3313ee6/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:37.145332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] MFA Rules not processed for user `8e898ef350cf4c1ca0c407c513c45e44`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:37.145332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:37.146862 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.147446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.148650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.202418 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] MFA Rules not processed for user `7ca34f2703a544b9b4649333b3313ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:37.204157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:37.269702 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1300/2608] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:37.320582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1309/2609] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:37.324857 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.344020 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.345906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:37.425925 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a405dc-c270-490c-8059-5cd2f8ec6fdd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.430543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0779-02f3-4e34-a683-44e3994ce519 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.432576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.433550 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.433782 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.434164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.438038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.438180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.438180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.438180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.438180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.451932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.467939 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.478833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.489421 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1310/2610] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:37.565839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1301/2611] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:37 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:37.571433 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.583919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa53ee-2982-49a3-b3d0-1b94ed4a0340 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.664830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.665650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.666078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.666463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.667267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.693738 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.774261 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.839579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ac5b-edd0-43a5-b577-34de2696a049 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.843064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.843660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.843952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.844232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.845914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:37.862207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1311/2612] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:37 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:37.864139 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.874916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac105b-4a65-4dcb-bb0d-b5ab1c2af7a1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.879617 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.880128 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.880414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.880690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.881387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.907586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.922180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1312/2613] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:37.927582 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:37.930440 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:37.938739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd4a3-cb34-4431-8d73-2b97eb9c4812 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:37.943610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:37.944762 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:37.945145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:37.945649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] PATH_INFO: `/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:37.958118 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:37.970325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1302/2614] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:37.970686 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0228973f3a14816a8a5b579815ae5c2, user_id=9d05f183bf664691a444890214f0c22a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.004108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.046327 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.047684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:38.061749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7c7a-fb4e-4314-870c-5d28aa1428ae service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.067149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.068000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.068282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.068582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] PATH_INFO: `/v3/users/7e237c1d4c1c4417a3f7686c8fd56632` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.069748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e237c1d4c1c4417a3f7686c8fd56632)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.095732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.099192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1313/2615] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:37 2022] PUT /identity/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:38.101461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.178305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e4b-fa59-4926-8307-4e887128224c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.183529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.184144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.184436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.184719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.185422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.211671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.222445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1314/2616] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:38.227378 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.237070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16735c-c275-42d4-8071-d512e33d438f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.242529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.243459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.243626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.243949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] PATH_INFO: `/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.245702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0228973f3a14816a8a5b579815ae5c2, user_id=9d05f183bf664691a444890214f0c22a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.273306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.284250 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1315/2617] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:38 2022] PUT /identity/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:38.289078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.312082 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e237c1d4c1c4417a3f7686c8fd56632'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:38.376537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1b15-19b3-4130-b10d-30d7e2c5db91 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.381114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.383741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.383741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.383741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.383741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.408852 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.420302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1316/2618] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:38.425340 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.425966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e237c1d4c1c4417a3f7686c8fd56632'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:38.434736 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604922bf-2b84-4605-acdc-bfd1bab3cc81 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.441329 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e237c1d4c1c4417a3f7686c8fd56632'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:38.441468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.441468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.441468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.441468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] PATH_INFO: `/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.443312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0228973f3a14816a8a5b579815ae5c2, user_id=9d05f183bf664691a444890214f0c22a, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.447281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e237c1d4c1c4417a3f7686c8fd56632'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:38.447973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-99533585-8af3-4e89-af6c-e06ead6bd033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e237c1d4c1c4417a3f7686c8fd56632'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:38.453816 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1303/2619] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:38 2022] DELETE /identity/v3/users/7e237c1d4c1c4417a3f7686c8fd56632 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:38.458276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.458565 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.458885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.470709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc554ba-1955-47da-88e6-a564306c0031 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.483326 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:38.484476 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:38.553839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1317/2620] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:38 2022] PUT /identity/v3/projects/a0228973f3a14816a8a5b579815ae5c2/users/9d05f183bf664691a444890214f0c22a/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:38.564319 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1304/2621] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:38.565994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.566142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.566495 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.581269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.582773 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:38.612464 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] MFA Rules not processed for user `9d05f183bf664691a444890214f0c22a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:38.614513 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:38.693626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfab4f-f8b5-49d6-adac-39cec57c2603 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.717970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1318/2622] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:38.736662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:38.738967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:38.784670 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.785447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.785754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.786239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.895176 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.926217 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef186d-e9fa-414a-9e1d-54eb8f21d162 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:38.929956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.930383 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:38.931040 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:38.931339 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:38.931624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:38.948007 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:38.955173 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1305/2623] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:38.985327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:38.997983 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1319/2624] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:39.590003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:39.591367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:39.605255 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e58cf-c561-42f5-9f43-e5b5dab05da1 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:39.617583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:39.617583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:39.617583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:39.617583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] PATH_INFO: `/v3/projects/4f0b2e1ef43246e9bba4d09637fb1363` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:39.618225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0b2e1ef43246e9bba4d09637fb1363)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:39.640351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:39.813633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0b2e1ef43246e9bba4d09637fb1363', 'request_id': 'req-0fd1a78a-506e-4de6-8322-3a9d11f460af'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:39.918967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0b2e1ef43246e9bba4d09637fb1363', 'request_id': 'req-0fd1a78a-506e-4de6-8322-3a9d11f460af'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:39.935256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0b2e1ef43246e9bba4d09637fb1363', 'request_id': 'req-0fd1a78a-506e-4de6-8322-3a9d11f460af'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:39.947851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] The token cache is being invalidate because project 4f0b2e1ef43246e9bba4d09637fb1363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:39.948283 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:39.949158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:39.951519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1306/2625] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:39 2022] DELETE /identity/v3/projects/4f0b2e1ef43246e9bba4d09637fb1363 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:39.956835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:39.972159 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc3529-f275-48f6-aeb3-a0a972a2d2d3 service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:40.048303 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:40.049374 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:40.049523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:40.049716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] PATH_INFO: `/v3/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:40.050878 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6f8f0b4ed14d6fa9db3ba1cd6f33a8)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:40.078971 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:40.229299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:40.230956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:40.266302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6f8f0b4ed14d6fa9db3ba1cd6f33a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:40.275739 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6f8f0b4ed14d6fa9db3ba1cd6f33a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:40.338743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1a78a-506e-4de6-8322-3a9d11f460af admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:40.344969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05f183bf664691a444890214f0c22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0228973f3a14816a8a5b579815ae5c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:40.345954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:40.346430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:40.346808 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6f8f0b4ed14d6fa9db3ba1cd6f33a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:40.346945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:40.348033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:40.348513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:40.362068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6f8f0b4ed14d6fa9db3ba1cd6f33a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:40.363442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6f8f0b4ed14d6fa9db3ba1cd6f33a8'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:40.371679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1320/2626] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:39 2022] DELETE /identity/v3/users/5d6f8f0b4ed14d6fa9db3ba1cd6f33a8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:40.401408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:40.418468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1307/2627] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:27:40.422755 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:40.424782 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:40.530958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d361-7c81-4159-b649-8d1ef5c9bd6b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:40.535709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05f183bf664691a444890214f0c22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0228973f3a14816a8a5b579815ae5c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:40.537632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:40.539057 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:40.541257 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:40.542079 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:40.571861 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:40.721540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1321/2628] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:40 2022] POST /identity/v3/projects => generated 354 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:40.727937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:40.740164 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24d2cd-4b39-4aea-9c28-fbf8e723d82e tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:40.822061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05f183bf664691a444890214f0c22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0228973f3a14816a8a5b579815ae5c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:40.822973 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:40.823408 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:40.823862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:40.824936 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:40.825396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:40.872989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:40.889100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1308/2629] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:40.950980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:40.971978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921967-1c4f-488b-bdff-a4acbe4f7405 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:40.979562 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05f183bf664691a444890214f0c22a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0228973f3a14816a8a5b579815ae5c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:40.981156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:40.981896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:40.982492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] PATH_INFO: `/v3/projects/bd64cb55bf2c4149b10274bbc0bc116e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:40.986063 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd64cb55bf2c4149b10274bbc0bc116e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:41.014304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:41.040684 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:41.043257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:41.135095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42fdd-ab84-47f9-a654-3957b621a482 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:41.146831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd64cb55bf2c4149b10274bbc0bc116e', 'request_id': 'req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.158909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd64cb55bf2c4149b10274bbc0bc116e', 'request_id': 'req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.165118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd64cb55bf2c4149b10274bbc0bc116e', 'request_id': 'req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.211619 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:41.213409 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:41.213828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:41.214162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] PATH_INFO: `/v3/projects/e2d03363c73a4374a1d814bc38261f3a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:41.216887 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d03363c73a4374a1d814bc38261f3a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:41.257788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] The token cache is being invalidate because project bd64cb55bf2c4149b10274bbc0bc116e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:41.258091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.260080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:41.262417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4d55a74e-57bf-4fa7-afee-62ec8f4443b6 tempest-VolumeQuotaClassesTest-1047143099 tempest-VolumeQuotaClassesTest-1047143099-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.266227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1322/2630] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:40 2022] DELETE /identity/v3/projects/bd64cb55bf2c4149b10274bbc0bc116e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:41.415954 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d03363c73a4374a1d814bc38261f3a', 'request_id': 'req-0309ebbd-6b1c-4301-9020-30161cbe6020'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.509107 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d03363c73a4374a1d814bc38261f3a', 'request_id': 'req-0309ebbd-6b1c-4301-9020-30161cbe6020'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.526150 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d03363c73a4374a1d814bc38261f3a', 'request_id': 'req-0309ebbd-6b1c-4301-9020-30161cbe6020'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.537221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] The token cache is being invalidate because project e2d03363c73a4374a1d814bc38261f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:41.537487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.538368 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-0309ebbd-6b1c-4301-9020-30161cbe6020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:41.540801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1309/2631] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:41 2022] DELETE /identity/v3/projects/e2d03363c73a4374a1d814bc38261f3a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:41.546038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:41.546334 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:41.546615 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:41.580239 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:41.581501 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:41.696251 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1323/2632] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:41.704585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:41.705701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:41.705701 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:41.730608 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:41.732050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:41.740295 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1310/2633] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:41.745196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:41.755839 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f4a7-ecf8-4c1e-8a5a-394de4d225bc None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:41.761771 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:41.762658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:41.763194 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:41.763517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:41.764224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:41.764526 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:41.792616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:41.808542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1324/2634] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:41.813041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:41.822793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7c03-2b76-45e2-93aa-0da898397fcc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:41.827497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:41.828083 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:41.828367 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:41.828646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:41.829277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:41.856325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:41.970020 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1311/2635] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:41.974351 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:41.984675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9156f-4336-4a24-a131-cd6558ebee8e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.058542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.058542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.058542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.058542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.058984 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.061399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.063437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:42.075513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178ec0-4a8e-46f4-9090-178efc9f26c2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.080198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.080996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.081284 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.081560 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] PATH_INFO: `/v3/users/7ca34f2703a544b9b4649333b3313ee6` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.082689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca34f2703a544b9b4649333b3313ee6)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.087320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.109533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.220446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1325/2636] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:41 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:42.228160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.238247 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd019c-8a98-4e2c-a7cd-b605a9588bc7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.243428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.244089 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.244520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.244809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.245510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.271811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.282539 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1326/2637] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:42.291482 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.301296 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc33-0c79-4312-a551-7d106eaa9875 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.306923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.307777 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.308058 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.308327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] PATH_INFO: `/v3/projects/796d2efae8d549acafa06dbe877f1c21/users/b71ef6c47b944452a22fe98ccf970513/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.330463 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796d2efae8d549acafa06dbe877f1c21, user_id=b71ef6c47b944452a22fe98ccf970513, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.356919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad612af1-cf7c-4d28-8d70-a675f54191c1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.375548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca34f2703a544b9b4649333b3313ee6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:42.463764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1327/2638] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:42 2022] PUT /identity/v3/projects/796d2efae8d549acafa06dbe877f1c21/users/b71ef6c47b944452a22fe98ccf970513/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:42.475935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.475935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.475935 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.497275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca34f2703a544b9b4649333b3313ee6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:42.507609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca34f2703a544b9b4649333b3313ee6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:42.520282 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca34f2703a544b9b4649333b3313ee6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:42.521103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-41224305-4de9-4b33-888e-0404decae0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca34f2703a544b9b4649333b3313ee6'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:42.530520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] MFA Rules not processed for user `b71ef6c47b944452a22fe98ccf970513`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:42.530636 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1312/2639] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:42 2022] DELETE /identity/v3/users/7ca34f2703a544b9b4649333b3313ee6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:42.530732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:42.535389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.535873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.536358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.563286 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:42.565132 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:42.648468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1328/2640] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:42.653238 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.660754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:42.665590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1313/2641] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:42.675028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf27524-7a16-47c3-8d6e-e47d29b7dc30 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.682175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.683310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.683310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.683310 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.683965 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.685622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.687308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:42.714355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.770912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73161819-4785-4bc5-b3b8-eae02c8692a7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.779500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.779500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.779500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.779500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.787641 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:42.813846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:42.826136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1314/2642] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:42.838801 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1329/2643] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:42 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:42.842937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:42.856216 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b722-3e9c-4a69-89fa-9d86856dea0d service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:42.962448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:42.963512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:42.963991 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:42.964514 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:42.965716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:43.025961 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:43.157553 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1315/2644] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:42 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:43.158962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:43.169675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5d17-0bfb-4fe7-8f73-a4aac2f4426f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:43.174454 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:43.175066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:43.175534 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:43.175980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:43.177157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:43.211593 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aedd1-f736-466d-ae21-63a122c704d6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:43.224267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1330/2645] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:43.228579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:43.239597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d34f-e7ef-4186-b872-c337caac53c3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:43.253019 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:43.254100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:43.255016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:43.255016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] PATH_INFO: `/v3/projects/a1b2f84eeb184b568f40205a9dd1258e/users/c4504e32876f427f99a64df57f72c9ca/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:43.286339 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b2f84eeb184b568f40205a9dd1258e, user_id=c4504e32876f427f99a64df57f72c9ca, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:43.318197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:43.542009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1316/2646] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:43 2022] PUT /identity/v3/projects/a1b2f84eeb184b568f40205a9dd1258e/users/c4504e32876f427f99a64df57f72c9ca/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:43.552510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:43.552811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:43.553090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:43.604997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] MFA Rules not processed for user `c4504e32876f427f99a64df57f72c9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:43.610404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:43.612362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:43.618231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:43.720343 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1331/2647] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:43 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:43.721314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7bf0-85e7-4431-858c-1e86409fc12a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:43.725338 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:43.734717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:43.734717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:43.734717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:43.734717 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] PATH_INFO: `/v3/projects/7b7343214d8e40849ec4b4ff31f9fdc3` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:43.735270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7343214d8e40849ec4b4ff31f9fdc3)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:43.742675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219192c-5caa-4769-97e6-9769e1a093ff None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:43.753511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:43.754147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:43.754477 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:43.754744 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:43.755349 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:43.768617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:43.782305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:43.906095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7343214d8e40849ec4b4ff31f9fdc3', 'request_id': 'req-b107375f-0c7b-4d76-8639-34ea744db3f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:43.955130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1332/2648] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:43 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:43.957350 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:43.989898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7343214d8e40849ec4b4ff31f9fdc3', 'request_id': 'req-b107375f-0c7b-4d76-8639-34ea744db3f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.006883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7343214d8e40849ec4b4ff31f9fdc3', 'request_id': 'req-b107375f-0c7b-4d76-8639-34ea744db3f1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.023400 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] The token cache is being invalidate because project 7b7343214d8e40849ec4b4ff31f9fdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:44.023855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.024538 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.026233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1317/2649] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:43 2022] DELETE /identity/v3/projects/7b7343214d8e40849ec4b4ff31f9fdc3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:44.034727 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.036669 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:44.049346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31eb9-a48d-419d-9adb-f5dfbe22b70b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.057102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.057102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.057102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.057102 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.057893 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.085445 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.126051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107375f-0c7b-4d76-8639-34ea744db3f1 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.130477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.131277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.131576 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.132156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] PATH_INFO: `/v3/users/9d05f183bf664691a444890214f0c22a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.133593 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d05f183bf664691a444890214f0c22a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.160482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.176618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1333/2650] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:43 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:44.181822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.183430 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:44.196154 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ea88-ffda-4cc6-90ef-736d0f7754f0 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.205560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.206298 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.206563 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.206831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.207521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.237243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.247918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1334/2651] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:44.252487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.262234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd098d6-f960-412c-8e4f-00017554e9ce admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.266610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.275065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.275065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.275065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] PATH_INFO: `/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.289348 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef9fb8e7ff84fdd8468f79e1ca55cee, user_id=40be2ea7c2d14290960add50a9f4387a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.315478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.389599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d05f183bf664691a444890214f0c22a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.421688 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1335/2652] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:44 2022] PUT /identity/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:44.425690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.490504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d05f183bf664691a444890214f0c22a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.495853 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f337-b09f-4ec6-998b-89d1af9c037a admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.503310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d05f183bf664691a444890214f0c22a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.503453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.503453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.503453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.503453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.503780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.512336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d05f183bf664691a444890214f0c22a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.513016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d05f183bf664691a444890214f0c22a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:44.518852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1318/2653] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:44 2022] DELETE /identity/v3/users/9d05f183bf664691a444890214f0c22a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:44.531147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.543075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1336/2654] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:44.547671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.549379 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:44.629167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a94b-d280-4f6e-9ace-c6223d6056e7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.634258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.635089 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.641075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.641075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] PATH_INFO: `/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.641075 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef9fb8e7ff84fdd8468f79e1ca55cee, user_id=40be2ea7c2d14290960add50a9f4387a, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.665131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.681530 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1319/2655] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:44 2022] PUT /identity/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:44.681772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.693800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f763fac-61e2-47a1-94db-24d7f2735afa admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.762015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.762723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.763017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.763299 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.763998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.790329 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604657-2efc-4ece-a5bd-d2e2f3ff068b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.802612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1337/2656] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:44.807523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:44.820318 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da30886-0def-45fe-99a0-85769210e66f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:44.825060 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:44.826136 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.826609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.827093 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] PATH_INFO: `/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:44.830458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef9fb8e7ff84fdd8468f79e1ca55cee, user_id=40be2ea7c2d14290960add50a9f4387a, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:44.863354 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:44.966955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1320/2657] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:44 2022] PUT /identity/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee/users/40be2ea7c2d14290960add50a9f4387a/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:44.973369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:44.973667 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:44.973978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.014564 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] MFA Rules not processed for user `40be2ea7c2d14290960add50a9f4387a`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:45.015730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.105787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1338/2658] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:45.112847 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:45.114597 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.158336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:45.160869 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.258158 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb9bc1-e552-4bfe-bef0-167b4b5888ce admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:45.264549 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:45.265574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.266221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.266726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.282243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:45.288510 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32327ace-604e-433b-b0e1-7934fe8b51af None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:45.295977 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:45.297638 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.298446 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.300368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] PATH_INFO: `/v3/projects/a0228973f3a14816a8a5b579815ae5c2` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.302795 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0228973f3a14816a8a5b579815ae5c2)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:45.312814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7374dfc-4678-41b3-b4b0-a1bff3ae8123 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:45.336901 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1321/2659] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:45 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:45.350368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:45.519760 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0228973f3a14816a8a5b579815ae5c2', 'request_id': 'req-2cc91c16-cca5-4967-ab5f-ff120696f33d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:45.532355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0228973f3a14816a8a5b579815ae5c2', 'request_id': 'req-2cc91c16-cca5-4967-ab5f-ff120696f33d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:45.537748 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0228973f3a14816a8a5b579815ae5c2', 'request_id': 'req-2cc91c16-cca5-4967-ab5f-ff120696f33d'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:45.599282 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] The token cache is being invalidate because project a0228973f3a14816a8a5b579815ae5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:45.603872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:45.603872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:45.603872 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1339/2660] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:45 2022] DELETE /identity/v3/projects/a0228973f3a14816a8a5b579815ae5c2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:45.607946 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8789d0-b4c3-4842-94a2-58d0fa7b666a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.608244 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8789d0-b4c3-4842-94a2-58d0fa7b666a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.608527 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8789d0-b4c3-4842-94a2-58d0fa7b666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.633398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-9c8789d0-b4c3-4842-94a2-58d0fa7b666a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:45.634595 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9c8789d0-b4c3-4842-94a2-58d0fa7b666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.682022 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:45.684031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.718613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1322/2661] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:45.726663 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.726956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.727239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.751904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:45.753080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:45.762277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1323/2662] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:45.771423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:45.779856 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91c16-cca5-4967-ab5f-ff120696f33d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:45.780859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532dda-e9c5-432b-8f1e-2be330fc30d4 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:45.784592 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:45.785404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.785591 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:45.785741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.790788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] PATH_INFO: `/v3/users/b9b112aa308543fe8bbf39dcb00fa939` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.790953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.790953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.790953 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.791232 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b112aa308543fe8bbf39dcb00fa939)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:45.791325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:45.791325 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:45.814371 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:45.815052 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:45.829904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1324/2663] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:45.834640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:45.844172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca435-b3a6-4da1-b9ab-0180b7d99a71 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:45.851374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:45.859534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:45.859534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:45.859534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:45.859534 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:45.887322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:45.978254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1325/2664] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:45 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:45.982484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.059108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a89e7-a860-43b9-8752-b17cfc0d89ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.060228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b112aa308543fe8bbf39dcb00fa939'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:46.063610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.064233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.064536 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.064806 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.065445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.068594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b112aa308543fe8bbf39dcb00fa939'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:46.091059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.158963 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b112aa308543fe8bbf39dcb00fa939'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:46.172231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b112aa308543fe8bbf39dcb00fa939'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:46.173369 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-2794d854-5a10-4ba5-ac1f-eed78d460053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b112aa308543fe8bbf39dcb00fa939'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:46.180158 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1340/2665] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:45 2022] DELETE /identity/v3/users/b9b112aa308543fe8bbf39dcb00fa939 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:46.184740 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.185037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.185327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.194472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1326/2666] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:45 2022] POST /identity/v3/users => generated 305 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:46.201386 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.203050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.209023 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:46.210998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.214658 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95453612-0499-4d81-a082-86f4169a57c0 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.280602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1341/2667] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:46.292730 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.294205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.318095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.318095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.318095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.318095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.318653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.343844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.355331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1327/2668] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:46.359671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.370478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdacf0-aa92-4f12-a742-3ec6317bfff3 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.370845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad7644-3032-4d29-8de2-8b64cad8a7bd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.373962 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.374565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.382832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.382832 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.383126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.383126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.383126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.383126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] PATH_INFO: `/v3/projects/6a0548ef5f3444e7a64c517c01e71571/users/21e115f1024745d089ef250c6233c5ac/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.385923 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.411276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0548ef5f3444e7a64c517c01e71571, user_id=21e115f1024745d089ef250c6233c5ac, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.417920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b273af-07d0-4402-95a7-92e78afa6818 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.422910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1342/2669] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:46.440421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.537141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1328/2670] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:46 2022] PUT /identity/v3/projects/6a0548ef5f3444e7a64c517c01e71571/users/21e115f1024745d089ef250c6233c5ac/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:46.551080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.551485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.551850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.587873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.589510 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.611187 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] MFA Rules not processed for user `21e115f1024745d089ef250c6233c5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:46.612359 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.668621 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704e5af-e41d-4ed4-be8b-a187d204d3cc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.672227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.672846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.673143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.673430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.675197 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:46.733065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1343/2671] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3716 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:46.734246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.757799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.791941 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.805378 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1329/2672] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:46 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:46.830414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e3ae-7191-4388-b6f1-d36102b15c60 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:46.836859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:46.838613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:46.838613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:46.838613 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:46.839237 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:46.870254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:46.971845 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1344/2673] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:46 2022] POST /identity/v3/projects => generated 409 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:46.977183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:46.989375 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a775c-4d22-4a07-962a-3033a121255b service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.045475 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.048108 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:47.068780 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.070646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.071334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.071785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.073448 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.112481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.160324 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837fd76-d316-4514-90fd-a37f9925106c admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.164871 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.165470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.165759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.166204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.167911 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:47.222739 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1330/2674] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:46 2022] POST /identity/v3/users => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:47.223314 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.230050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:47.249302 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f12b78-5a58-4548-9930-8a7e66d7ee48 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.255861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.257888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.258479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.258917 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] PATH_INFO: `/v3/projects/5fc6ff5919ee4a5face4a6c2620d34e1` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.260696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc6ff5919ee4a5face4a6c2620d34e1)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.277646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.290660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.332291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.348224 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1345/2675] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:47.350769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.366346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3339cf0-ad12-4001-ac03-094af56bc6a0 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.373899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.374589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.374822 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.376387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.376387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.404066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.416799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1346/2676] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:27:47.422896 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.437484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ec0a-813a-48b0-9886-98d78980c827 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.439568 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc6ff5919ee4a5face4a6c2620d34e1', 'request_id': 'req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.519910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.521173 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.521417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.521837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] PATH_INFO: `/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.535812 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc6ff5919ee4a5face4a6c2620d34e1', 'request_id': 'req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.548310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc6ff5919ee4a5face4a6c2620d34e1', 'request_id': 'req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.554168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1261cb9f4d342aaa240682251acf4c8, user_id=79c226683d154decb47ab9e000951680, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.563574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] The token cache is being invalidate because project 5fc6ff5919ee4a5face4a6c2620d34e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:47.564012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.564882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.567143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1331/2677] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:47 2022] DELETE /identity/v3/projects/5fc6ff5919ee4a5face4a6c2620d34e1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:47.574766 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.576096 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:47.591854 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0aa7-4f49-4d6f-931e-a4b0011a0ce3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.600100 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.601353 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.601767 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.602141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.603264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] PATH_INFO: `/v3/users/8e898ef350cf4c1ca0c407c513c45e44` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.605585 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e898ef350cf4c1ca0c407c513c45e44)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.635263 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.709293 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1347/2678] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:47 2022] PUT /identity/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:47.713996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.717332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:47.815470 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82013647-ea33-4b17-84e0-e2d3ca21651d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.821246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.821891 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.822210 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.822491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.823284 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.849478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.853066 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e898ef350cf4c1ca0c407c513c45e44'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.861397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1348/2679] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:47.865690 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.875831 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f557e0-30f5-4d81-aa72-941fea00171e admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:47.886633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:47.887468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:47.887751 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:47.888031 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] PATH_INFO: `/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:47.889823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1261cb9f4d342aaa240682251acf4c8, user_id=79c226683d154decb47ab9e000951680, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:47.918467 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:47.929994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1349/2680] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:47 2022] PUT /identity/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:47.934178 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:47.959090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e898ef350cf4c1ca0c407c513c45e44'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.969791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e898ef350cf4c1ca0c407c513c45e44'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.987999 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e898ef350cf4c1ca0c407c513c45e44'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.988993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e898ef350cf4c1ca0c407c513c45e44'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:47.997215 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1332/2681] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:47 2022] DELETE /identity/v3/users/8e898ef350cf4c1ca0c407c513c45e44 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:27:48.027982 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e196-ac25-4612-bab8-47fd2f682d09 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:48.106998 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:48.107658 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:48.107951 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:48.108246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:48.108922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:48.138721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19cff-a8b4-4758-a500-aac9a3ae4ecb admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:48.155073 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1350/2682] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:48.157600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:48.158133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:48.171526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a174-a8aa-4f9f-b2c6-efa94022e3bb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:48.176001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:48.176826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:48.177112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:48.177389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] PATH_INFO: `/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:48.179937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1261cb9f4d342aaa240682251acf4c8, user_id=79c226683d154decb47ab9e000951680, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:48.207434 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:48.292662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1333/2683] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:48 2022] PUT /identity/v3/projects/e1261cb9f4d342aaa240682251acf4c8/users/79c226683d154decb47ab9e000951680/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:48.306958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:48.307305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:48.307591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:48.360379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] MFA Rules not processed for user `79c226683d154decb47ab9e000951680`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:48.361583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:48.478829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1351/2684] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3783 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:48.489599 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:48.494178 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:48.563814 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675552-4292-4b10-aecf-e0142ecd1d5a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:48.567308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:48.568028 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:48.568360 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:48.568643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:48.578533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:48.605548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:48.617458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1334/2685] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:48 2022] GET /identity/v3/auth/tokens => generated 3783 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:48.685721 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:48.686457 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:48.797944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736e66-3bc0-4a35-89f5-d7d2533d0b01 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:48.804214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:48.804887 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:48.805248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:48.805596 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] PATH_INFO: `/v3/projects/f26f7bf5551b42f494b5288653a3b74a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:48.807425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26f7bf5551b42f494b5288653a3b74a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:48.833767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.006666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26f7bf5551b42f494b5288653a3b74a', 'request_id': 'req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:49.019949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26f7bf5551b42f494b5288653a3b74a', 'request_id': 'req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:49.027262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26f7bf5551b42f494b5288653a3b74a', 'request_id': 'req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:49.081359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.083287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:49.095155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509997d-e833-49b7-862b-fc5b19aa63d1 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.146538 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] The token cache is being invalidate because project f26f7bf5551b42f494b5288653a3b74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:49.146746 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:49.147803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-1f0e8008-6dc3-4516-b382-47eaa63c9ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:49.150408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1352/2686] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:48 2022] DELETE /identity/v3/projects/f26f7bf5551b42f494b5288653a3b74a => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:49.159684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff240e-deff-4c6f-8dde-af7c8983eaaf None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.159684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff240e-deff-4c6f-8dde-af7c8983eaaf None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.159980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff240e-deff-4c6f-8dde-af7c8983eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.163337 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.163935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.164228 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.164512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.169172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:49.186428 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-09ff240e-deff-4c6f-8dde-af7c8983eaaf None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:49.187997 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-09ff240e-deff-4c6f-8dde-af7c8983eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:49.263009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:49.288372 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1353/2687] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:27:49.296079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.296487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.296781 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.297064 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.309141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1335/2688] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:49 2022] GET /identity/v3/auth/tokens => generated 3716 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:49.324522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:49.325670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:49.337468 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1354/2689] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:49.342331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.355856 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7151fbc-d25f-44e7-a5c0-c4cb7802cb74 service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.361227 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.361886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.362311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.362662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.363428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:27:49.363798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:49.393112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.409542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1336/2690] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:27:49.420525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.431155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4184f1-6619-484a-bc5c-4a26fb3beac8 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.436913 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.437689 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.438115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.438471 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.439226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:49.481767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.641425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1355/2691] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:27:49 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:27:49.645905 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.655964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6423-2da4-4f61-a372-6836e31ef4d7 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.727113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.727734 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.728031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.728332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.728968 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:49.755062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.871729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1337/2692] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:27:49 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:27:49.872909 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.883401 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb030-eefb-40de-b767-6ab3900ac3a1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.887610 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.888204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.888507 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.888770 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.889461 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:49.914964 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a14b-b9ea-495b-8a7b-a7431b81af1d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:49.925714 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1356/2693] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:27:49.930948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:49.941845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac847e-3324-4116-ba15-120f9dbf12d4 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:49.947260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:49.948078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:49.948544 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:49.948838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] PATH_INFO: `/v3/projects/cfe76a46488a40b584e925203db48f86/users/c6434d2a92a3418cae806af8bc4d5d06/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:49.970892 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe76a46488a40b584e925203db48f86, user_id=c6434d2a92a3418cae806af8bc4d5d06, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:50.002500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:50.082221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1338/2694] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:27:49 2022] PUT /identity/v3/projects/cfe76a46488a40b584e925203db48f86/users/c6434d2a92a3418cae806af8bc4d5d06/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:50.093422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be069-007d-44d2-998f-f95a411e5227 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:50.093716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be069-007d-44d2-998f-f95a411e5227 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:50.094038 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be069-007d-44d2-998f-f95a411e5227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:50.136373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-631be069-007d-44d2-998f-f95a411e5227 None None] MFA Rules not processed for user `c6434d2a92a3418cae806af8bc4d5d06`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:50.137899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-631be069-007d-44d2-998f-f95a411e5227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:50.231838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1357/2695] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:50.242371 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:50.244001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:50.323807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf061e8-37e4-43b2-9864-79769bf63c29 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:50.327986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:50.328634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:50.328929 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:50.329211 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:50.357613 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:50.368662 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec2b93-0a56-40db-8de3-d8989d3d5ef8 service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:50.378873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1339/2696] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:50 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:50.403712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be069-007d-44d2-998f-f95a411e5227 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:50.479162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631be069-007d-44d2-998f-f95a411e5227 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:50.483816 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:50.484684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:50.484978 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:50.485262 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] PATH_INFO: `/v3/users/c6434d2a92a3418cae806af8bc4d5d06` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:50.486741 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6434d2a92a3418cae806af8bc4d5d06)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:50.512652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:50.906353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6434d2a92a3418cae806af8bc4d5d06'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:50.916497 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6434d2a92a3418cae806af8bc4d5d06'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:51.019705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6434d2a92a3418cae806af8bc4d5d06'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:51.037160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6434d2a92a3418cae806af8bc4d5d06'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:51.038140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6434d2a92a3418cae806af8bc4d5d06'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:51.044693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1358/2697] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:50 2022] DELETE /identity/v3/users/c6434d2a92a3418cae806af8bc4d5d06 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:51.048988 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:51.049289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:51.049569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:51.074162 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:51.075313 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:51.152840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1340/2698] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:51.164115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:51.165967 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:51.247609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69652a57-40a6-43cd-94fa-7daceb22f7a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:51.251649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:51.252438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:51.252731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:51.257833 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:51.264987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:51.302898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:51.329048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1359/2699] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:52.151844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:52.155904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:52.174287 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c7713-5d1d-475e-8163-0ac30426c99f None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:52.179573 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:52.180388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:52.180679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:52.180964 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] PATH_INFO: `/v3/projects/cfe76a46488a40b584e925203db48f86` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:52.182149 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe76a46488a40b584e925203db48f86)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:52.208837 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:52.380095 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe76a46488a40b584e925203db48f86', 'request_id': 'req-f1f21887-4987-458a-adc1-7233d869f492'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:52.478524 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe76a46488a40b584e925203db48f86', 'request_id': 'req-f1f21887-4987-458a-adc1-7233d869f492'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:52.491656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe76a46488a40b584e925203db48f86', 'request_id': 'req-f1f21887-4987-458a-adc1-7233d869f492'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:52.502908 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] The token cache is being invalidate because project cfe76a46488a40b584e925203db48f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:52.503269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:52.504031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:52.505610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1341/2700] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:52 2022] DELETE /identity/v3/projects/cfe76a46488a40b584e925203db48f86 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:52.931395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:52.932727 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:52.997577 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb922d-d03e-4f3e-be72-c0223dd7ec63 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:53.055277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:53.055955 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:53.056243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:53.056523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:53.058270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:53.126230 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:53.153056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd237-2c81-4fd5-8615-1de140f57555 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:53.162718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1360/2701] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:27:58.016724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:58.018628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:58.097424 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21887-4987-458a-adc1-7233d869f492 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:58.102678 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:58.103618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:58.103907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:58.104189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] PATH_INFO: `/v3/users/b71ef6c47b944452a22fe98ccf970513` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:58.105372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71ef6c47b944452a22fe98ccf970513)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:58.132272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:58.353000 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71ef6c47b944452a22fe98ccf970513'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:58.494191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71ef6c47b944452a22fe98ccf970513'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:58.507108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71ef6c47b944452a22fe98ccf970513'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:58.523214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71ef6c47b944452a22fe98ccf970513'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:58.524152 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71ef6c47b944452a22fe98ccf970513'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:58.530664 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1342/2702] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:58 2022] DELETE /identity/v3/users/b71ef6c47b944452a22fe98ccf970513 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:58.539700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:58.539700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:58.539700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:58.564177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:27:58.565365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:58.647575 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1361/2703] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:27:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:27:58.658116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:58.659481 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:58.749235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8f916-29e9-494e-9689-b2b42d9e653a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:58.753102 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:58.753852 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:58.754144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:58.754454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:58.770598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:58.806622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:58.823423 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1343/2704] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:27:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:27:59.408719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:59.410133 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:27:59.425409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9a62-48ef-4982-a81e-b146666197f4 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:59.431030 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:59.431160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:59.431425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:59.431707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] PATH_INFO: `/v3/projects/796d2efae8d549acafa06dbe877f1c21` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:59.432785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796d2efae8d549acafa06dbe877f1c21)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:59.458313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:59.586490 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796d2efae8d549acafa06dbe877f1c21', 'request_id': 'req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:59.597306 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796d2efae8d549acafa06dbe877f1c21', 'request_id': 'req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:59.604515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796d2efae8d549acafa06dbe877f1c21', 'request_id': 'req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:59.689328 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] The token cache is being invalidate because project 796d2efae8d549acafa06dbe877f1c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:27:59.689656 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:59.690213 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:27:59.691639 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1362/2705] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:27:59 2022] DELETE /identity/v3/projects/796d2efae8d549acafa06dbe877f1c21 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:27:59.695872 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:27:59.705272 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f7427-9d61-4389-80d5-8d4dee87a9ad service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:27:59.770014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:27:59.770831 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:27:59.771123 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:27:59.771405 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] PATH_INFO: `/v3/users/c4504e32876f427f99a64df57f72c9ca` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:27:59.772729 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4504e32876f427f99a64df57f72c9ca)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:27:59.799306 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:27:59.972695 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4504e32876f427f99a64df57f72c9ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.021036 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4504e32876f427f99a64df57f72c9ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.030462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4504e32876f427f99a64df57f72c9ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.043170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4504e32876f427f99a64df57f72c9ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.043899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4504e32876f427f99a64df57f72c9ca'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.049869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1344/2706] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:27:59 2022] DELETE /identity/v3/users/c4504e32876f427f99a64df57f72c9ca => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:00.499302 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:00.500898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:00.513735 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e33b-7b7a-4fa3-840b-9e6575cce5b4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:00.577395 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:00.578227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:00.578512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:00.578794 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] PATH_INFO: `/v3/users/21e115f1024745d089ef250c6233c5ac` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:00.579876 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e115f1024745d089ef250c6233c5ac)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:00.605854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:00.636213 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:00.638185 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:00.652427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e56-7dc2-4618-8644-b49c96bacb95 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:00.657012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:00.657799 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:00.658121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:00.658430 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] PATH_INFO: `/v3/projects/a1b2f84eeb184b568f40205a9dd1258e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:00.659644 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b2f84eeb184b568f40205a9dd1258e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:00.686603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:00.826175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e115f1024745d089ef250c6233c5ac'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.834138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e115f1024745d089ef250c6233c5ac'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.860128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b2f84eeb184b568f40205a9dd1258e', 'request_id': 'req-194fd5e1-36e5-45c5-a833-66755a9752d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.941805 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e115f1024745d089ef250c6233c5ac'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.958956 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e115f1024745d089ef250c6233c5ac'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.959731 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-c76b0a44-b4c5-490f-8601-bde6aa700308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e115f1024745d089ef250c6233c5ac'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:00.965863 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1363/2707] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:00 2022] DELETE /identity/v3/users/21e115f1024745d089ef250c6233c5ac => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:00.970177 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:00.970473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:00.970752 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:00.994408 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:00.995561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:01.039001 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b2f84eeb184b568f40205a9dd1258e', 'request_id': 'req-194fd5e1-36e5-45c5-a833-66755a9752d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.050848 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b2f84eeb184b568f40205a9dd1258e', 'request_id': 'req-194fd5e1-36e5-45c5-a833-66755a9752d2'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.064732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] The token cache is being invalidate because project a1b2f84eeb184b568f40205a9dd1258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:01.073891 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.074196 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1364/2708] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:01.074303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.074303 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1345/2709] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:00 2022] DELETE /identity/v3/projects/a1b2f84eeb184b568f40205a9dd1258e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:01.074489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:01.074489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:01.076260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:01.077612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:01.086916 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ef5d7-47d5-4527-a1a4-6b3e846ce83e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:01.091249 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:01.092055 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:01.092452 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:01.092747 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] PATH_INFO: `/v3/users/40be2ea7c2d14290960add50a9f4387a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:01.093857 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40be2ea7c2d14290960add50a9f4387a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:01.120400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:01.144331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd5e1-36e5-45c5-a833-66755a9752d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:01.204166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:01.204667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:01.204950 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:01.205225 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:01.206979 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:01.219620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:01.246133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:01.257451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1346/2710] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:01.343425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40be2ea7c2d14290960add50a9f4387a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.352314 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40be2ea7c2d14290960add50a9f4387a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.432276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40be2ea7c2d14290960add50a9f4387a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.444673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40be2ea7c2d14290960add50a9f4387a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.445271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40be2ea7c2d14290960add50a9f4387a'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:01.451132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1365/2711] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:01 2022] DELETE /identity/v3/users/40be2ea7c2d14290960add50a9f4387a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:01.805762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:01.807509 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:01.821763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff76c-a151-461f-a0cf-f6178ac5d34b service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:01.891294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:01.892094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:01.892390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:01.892671 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] PATH_INFO: `/v3/projects/6a0548ef5f3444e7a64c517c01e71571` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:01.893775 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0548ef5f3444e7a64c517c01e71571)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:01.920042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:02.033886 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0548ef5f3444e7a64c517c01e71571', 'request_id': 'req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.139384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:02.141091 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:02.156590 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0548ef5f3444e7a64c517c01e71571', 'request_id': 'req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.157192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ba84c-9d73-4a0a-94ea-9dcdcd0f8387 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:02.165661 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0548ef5f3444e7a64c517c01e71571', 'request_id': 'req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.175974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] The token cache is being invalidate because project 6a0548ef5f3444e7a64c517c01e71571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:02.176417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.177055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.179245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1347/2712] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:01 2022] DELETE /identity/v3/projects/6a0548ef5f3444e7a64c517c01e71571 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:02.183230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:02.184648 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:02.222917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:02.223715 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.224006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.224291 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] PATH_INFO: `/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.225830 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef9fb8e7ff84fdd8468f79e1ca55cee)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:02.251354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:02.258630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1bb1c-8072-40db-8a8a-95ac5afe40d9 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:02.263055 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:02.263804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.264097 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.264390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] PATH_INFO: `/v3/users/79c226683d154decb47ab9e000951680` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.265504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c226683d154decb47ab9e000951680)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:02.291072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:02.421684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef9fb8e7ff84fdd8468f79e1ca55cee', 'request_id': 'req-a11b7d16-4de6-459f-8cda-ad366cee386b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.434111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef9fb8e7ff84fdd8468f79e1ca55cee', 'request_id': 'req-a11b7d16-4de6-459f-8cda-ad366cee386b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.439174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef9fb8e7ff84fdd8468f79e1ca55cee', 'request_id': 'req-a11b7d16-4de6-459f-8cda-ad366cee386b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.579104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] The token cache is being invalidate because project fef9fb8e7ff84fdd8468f79e1ca55cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:02.581160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.581160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-a11b7d16-4de6-459f-8cda-ad366cee386b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.582671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1366/2713] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:02 2022] DELETE /identity/v3/projects/fef9fb8e7ff84fdd8468f79e1ca55cee => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:02.589780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571adda-754a-40c1-bf86-24a0444409fc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.590115 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571adda-754a-40c1-bf86-24a0444409fc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.590403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571adda-754a-40c1-bf86-24a0444409fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.612376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-5571adda-754a-40c1-bf86-24a0444409fc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:02.613537 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-5571adda-754a-40c1-bf86-24a0444409fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:02.617417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c226683d154decb47ab9e000951680'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.680243 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1367/2714] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:02.688473 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.688779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.689067 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.706732 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c226683d154decb47ab9e000951680'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.711922 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:02.713083 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:02.716310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c226683d154decb47ab9e000951680'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.722234 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1368/2715] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:02.726670 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:02.731072 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c226683d154decb47ab9e000951680'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.732281 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c226683d154decb47ab9e000951680'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:02.738136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5127-e4fd-4181-846c-f34cf718354c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:02.740467 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1348/2716] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:02 2022] DELETE /identity/v3/users/79c226683d154decb47ab9e000951680 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:02.742924 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:02.743523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.743889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.744104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.744834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:28:02.745132 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:02.771062 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:02.788797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1369/2717] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:28:02.790288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:02.791781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:02.867124 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b540a-295c-4f7a-8a9b-9956cc2b2dfc admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:02.871861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:02.893190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:02.893190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:02.893190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:02.893190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:02.900456 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.056110 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1349/2718] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:02 2022] POST /identity/v3/projects => generated 401 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:03.060898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.072068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5b4c-9e30-48e8-ae5e-2fb7cbc4d967 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.149246 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.149975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.150171 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.150459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.151107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.176094 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.330387 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1370/2719] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/users => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:03.334861 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.345258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037064a-2042-48f3-b5b7-99dae87b5194 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.351755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.352348 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.356795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.356795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.356795 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.381956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.398820 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1350/2720] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:03.402626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.413611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9789-4871-4ea7-b960-c1748283c5c4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.415834 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.417413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:03.429675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.430536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.430824 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.431236 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] PATH_INFO: `/v3/projects/683c9e4ef07c42d3a6f6807ff79625c3/users/60945ad51c2947579714d7aab3176a4b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.431450 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185861-1a29-421e-ad2a-96050b4488ae admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.435657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.436447 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.436736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.437143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] PATH_INFO: `/v3/projects/e1261cb9f4d342aaa240682251acf4c8` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.438274 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1261cb9f4d342aaa240682251acf4c8)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.452136 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c9e4ef07c42d3a6f6807ff79625c3, user_id=60945ad51c2947579714d7aab3176a4b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.464606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.479228 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a9f6-cebd-4334-b0de-a1996b04104a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.587835 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1371/2721] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:03 2022] PUT /identity/v3/projects/683c9e4ef07c42d3a6f6807ff79625c3/users/60945ad51c2947579714d7aab3176a4b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:03.599113 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.599400 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.599683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.618754 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1261cb9f4d342aaa240682251acf4c8', 'request_id': 'req-7163fda6-908a-4513-be51-c5e00d883eee'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:03.639118 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] MFA Rules not processed for user `60945ad51c2947579714d7aab3176a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:03.640274 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:03.706640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1261cb9f4d342aaa240682251acf4c8', 'request_id': 'req-7163fda6-908a-4513-be51-c5e00d883eee'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:03.715602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1372/2722] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/auth/tokens => generated 3708 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:03.719451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1261cb9f4d342aaa240682251acf4c8', 'request_id': 'req-7163fda6-908a-4513-be51-c5e00d883eee'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:03.720153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.731016 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] The token cache is being invalidate because project e1261cb9f4d342aaa240682251acf4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:03.731532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:03.732146 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-7163fda6-908a-4513-be51-c5e00d883eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:03.733603 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1351/2723] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:03 2022] DELETE /identity/v3/projects/e1261cb9f4d342aaa240682251acf4c8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:03.738347 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915082c-9a60-4d88-a5b8-56849e6ebd1c None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.738711 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915082c-9a60-4d88-a5b8-56849e6ebd1c None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.739062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915082c-9a60-4d88-a5b8-56849e6ebd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.762298 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-4915082c-9a60-4d88-a5b8-56849e6ebd1c None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:03.763652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4915082c-9a60-4d88-a5b8-56849e6ebd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:03.797034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079873e-f721-47d7-a0d1-28e5b90e53c5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.801321 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.801918 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.802276 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.802552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.803181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.828780 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.830995 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1352/2724] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:03.839851 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.840398 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.840770 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.869632 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:03.871883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:03.879044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1353/2725] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:03.883418 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.892192 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c3cd-f3e0-4f64-9f1d-62139f41af88 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:03.896748 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:03.897876 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:03.898189 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:03.898554 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:03.899278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:28:03.899580 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:03.925232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:03.939103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1354/2726] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 10:28:03.942917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1373/2727] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/projects => generated 401 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:03.954634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.954946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:03.956985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:03.967807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796417f-e260-47a9-8104-89fbd27bd853 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.036931 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935832-9f7e-4272-a3ab-42157c8b7f72 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.037610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.038802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.039143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.039365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.039998 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.042385 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.042987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.043273 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.043552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.044174 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.065862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.071052 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.175793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1374/2728] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/users => generated 307 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:28:04.180090 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.190583 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abaf9-f1d5-43f0-87a8-84fd96beea08 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.195572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1355/2729] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:04.195859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.198422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.198422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.198422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.198422 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.201206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.223791 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.239360 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1375/2730] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:04.240702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.250759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579787e2-1bd7-4406-bbe3-4097132d08b5 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.282454 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8764c11-0e34-4a05-81d2-3e81df12dec8 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.287784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.288738 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.289034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.289320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.290240 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.316789 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.320597 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.321655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.321988 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.322255 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] PATH_INFO: `/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.343080 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e59f6e4a82444578e44d01622069604, user_id=3d3a34f6a8724b1d9cbc9643a38cc665, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.370018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.423205 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1356/2731] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:04 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:28:04.427385 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.437827 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6f15c-fdb3-47e7-b2ed-39fb1e5d03ba admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.442432 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.443031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.443322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.443604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.444942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.471078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.483407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1357/2732] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:04.487835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.500942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfd4-9817-4d51-8cc0-4a13b784f1d2 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.505574 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.506579 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.509260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.509260 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] PATH_INFO: `/v3/projects/174bd86847a848c39c1b9d630f627787/users/b2032310e8644a858d2b4afbc6b9edc4/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.523584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1376/2733] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:04 2022] PUT /identity/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:04.527897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.532174 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174bd86847a848c39c1b9d630f627787, user_id=b2032310e8644a858d2b4afbc6b9edc4, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.559479 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad274-e211-4c3a-976f-c063540eb6c6 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.603006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fbd4-d75b-4f32-96a1-d5f821910568 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.608134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.608742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.609027 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.609305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.610056 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.637769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.649111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1377/2734] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:04.653315 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.662694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76045fcb-8200-41dc-b47e-14451644f10f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.667897 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.668708 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.668994 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.669279 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] PATH_INFO: `/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.671192 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e59f6e4a82444578e44d01622069604, user_id=3d3a34f6a8724b1d9cbc9643a38cc665, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.685108 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1358/2735] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:04 2022] PUT /identity/v3/projects/174bd86847a848c39c1b9d630f627787/users/b2032310e8644a858d2b4afbc6b9edc4/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:04.686645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.686945 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.687235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.699944 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.715044 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1378/2736] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:04 2022] PUT /identity/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:04.719068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.729014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] MFA Rules not processed for user `b2032310e8644a858d2b4afbc6b9edc4`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:04.730442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:04.801812 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fdea-2c21-4abf-b70f-b093364f3e5d admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.807899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.808560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.808847 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.809143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.810147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.823104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1359/2737] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:04.829736 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.831061 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:04.837560 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.848140 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1379/2738] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:04.854153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.863695 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38c90-4690-4a1e-85bd-9140f9ae1686 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.868766 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.869616 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.869899 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.870207 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] PATH_INFO: `/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.872077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e59f6e4a82444578e44d01622069604, user_id=3d3a34f6a8724b1d9cbc9643a38cc665, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.898692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefdfef-3dc5-49e7-85eb-bbcecfa82414 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.899986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eaa81-b0af-4957-b464-f3d3bb5e25bc None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.903657 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:04.904243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:04.904540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:04.904823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:04.914277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:04.940493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:04.950473 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1360/2739] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:04 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:28:04.969987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:04.983869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b40a-18fc-4233-b85c-aa47a85465cf service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:04.988554 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1380/2740] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:04 2022] PUT /identity/v3/projects/1e59f6e4a82444578e44d01622069604/users/3d3a34f6a8724b1d9cbc9643a38cc665/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:05.000800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.001151 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.001399 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.039571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] MFA Rules not processed for user `3d3a34f6a8724b1d9cbc9643a38cc665`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:05.040724 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.060250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:05.060993 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.061442 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.061735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] PATH_INFO: `/v3/users/b2032310e8644a858d2b4afbc6b9edc4` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.062904 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2032310e8644a858d2b4afbc6b9edc4)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:05.089489 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:05.126111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1381/2741] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3775 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:05.137698 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:05.139006 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.205889 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e65def-ec19-4a8e-9158-51fd1fa2003c None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:05.209308 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:05.211078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.211366 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.211649 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.221285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:05.247515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c98b3-9b78-4790-b570-16e9f2af8c63 service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:05.258301 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1382/2742] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3775 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:28:05.362252 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2032310e8644a858d2b4afbc6b9edc4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:05.461053 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2032310e8644a858d2b4afbc6b9edc4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:05.469357 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2032310e8644a858d2b4afbc6b9edc4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:05.481650 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2032310e8644a858d2b4afbc6b9edc4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:05.482310 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2032310e8644a858d2b4afbc6b9edc4'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:05.488126 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1361/2743] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:04 2022] DELETE /identity/v3/users/b2032310e8644a858d2b4afbc6b9edc4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:05.492652 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.492946 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.493223 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.515783 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:05.516937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.585897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:05.586214 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1383/2744] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:05.587410 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.597453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:05.598796 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.660485 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562ccf-82e7-40f7-9804-2d611fc36e0f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:05.664428 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:05.665034 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.665344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.665796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.666807 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7666-f12e-4c75-ae16-9fec4fd39122 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:05.667755 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:05.670772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:05.671362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:05.671723 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:05.672075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:05.683906 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:05.709547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:05.720594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1384/2745] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:05.741249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:05.767635 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f261-67e1-436b-9120-d006b4ca64fa service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:05.777879 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1362/2746] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3708 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:06.316548 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:06.317985 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:06.330254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0759-82d0-4b30-a96e-f24509164603 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:06.336576 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:06.337438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:06.337728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:06.338045 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] PATH_INFO: `/v3/projects/174bd86847a848c39c1b9d630f627787` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:06.339141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174bd86847a848c39c1b9d630f627787)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:06.366937 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:06.513823 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174bd86847a848c39c1b9d630f627787', 'request_id': 'req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:06.538394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174bd86847a848c39c1b9d630f627787', 'request_id': 'req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:06.538394 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174bd86847a848c39c1b9d630f627787', 'request_id': 'req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:06.649245 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] The token cache is being invalidate because project 174bd86847a848c39c1b9d630f627787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:06.652779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:06.652779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-4ad7e5ce-78cd-4bd8-bd10-652c0f58dcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:06.652779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1385/2747] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:06 2022] DELETE /identity/v3/projects/174bd86847a848c39c1b9d630f627787 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:06.656349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:06.656869 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:06.656966 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:06.766633 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:06.767791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:06.836672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1363/2748] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:06.844258 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:06.844553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:06.844837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:06.867954 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:06.869147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:06.876713 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1386/2749] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:06.881048 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:06.891956 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c80be6-a6b9-4b85-8b83-d63d467c9ff5 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:06.902598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:06.903206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:06.903541 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:06.903819 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:06.904520 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:28:06.904818 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:06.931212 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:06.944860 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1364/2750] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:28:06.949160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:06.957902 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87afac-60f6-4beb-a06f-1e0f44e3eb75 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:06.963643 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:06.964679 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:06.965028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:06.965365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:06.966112 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:06.995919 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:07.091145 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1387/2751] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:06 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:07.095059 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:07.105753 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d903e63-5c0c-4173-ba56-f4d7da5f775a admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:07.167846 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:07.168455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:07.168743 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:07.169057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:07.169749 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:07.196080 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:07.261159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1365/2752] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:07 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:07.265624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:07.276037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a53d-f468-4a9b-a015-de6512c82eb6 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:07.280702 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:07.281320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:07.281604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:07.281881 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:07.282614 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:07.309542 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028362-1ed1-4ffb-9986-188d69e596cd admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:07.320520 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1388/2753] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:07.324741 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:07.334769 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6762a0-8ad5-4b81-85db-a3a981995308 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:07.341427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:07.341427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:07.341427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:07.341427 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] PATH_INFO: `/v3/projects/cff1c7b959864eb5ad4223866a87d5c2/users/abab3646bda8471aa0f00599040b4c6b/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:07.360824 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff1c7b959864eb5ad4223866a87d5c2, user_id=abab3646bda8471aa0f00599040b4c6b, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:07.390996 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:07.508226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1366/2754] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:07 2022] PUT /identity/v3/projects/cff1c7b959864eb5ad4223866a87d5c2/users/abab3646bda8471aa0f00599040b4c6b/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:07.513696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57001-d060-44d1-9f90-61a49c0b14bc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:07.514024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57001-d060-44d1-9f90-61a49c0b14bc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:07.514337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57001-d060-44d1-9f90-61a49c0b14bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:07.539993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-6ea57001-d060-44d1-9f90-61a49c0b14bc None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:07.541153 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-6ea57001-d060-44d1-9f90-61a49c0b14bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:07.609733 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1389/2755] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:07.620482 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:07.622466 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:07.693161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fc4a7-92dd-442c-969f-8dc85a1613ff admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:07.696874 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:07.697532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:07.697825 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:07.698177 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:07.708653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:07.735502 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:07.745880 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1367/2756] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:09.261275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cea9-bad8-44b7-af7f-f56fff27cf87 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:09.261793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cea9-bad8-44b7-af7f-f56fff27cf87 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:09.261793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cea9-bad8-44b7-af7f-f56fff27cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:09.298521 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-b953cea9-bad8-44b7-af7f-f56fff27cf87 None None] MFA Rules not processed for user `abab3646bda8471aa0f00599040b4c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:09.299669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b953cea9-bad8-44b7-af7f-f56fff27cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:09.380388 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1390/2757] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:09 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:09.390245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:09.391620 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:09.466933 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbda58-4a55-4582-8f30-eb2e67dd54f2 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:09.471733 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:09.472404 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:09.472794 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:09.473147 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:09.487041 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:09.514462 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:09.524942 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1368/2758] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:09 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:11.339547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:11.340068 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:11.340254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:11.347785 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:11.349165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.362277 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] MFA Rules not processed for user `abab3646bda8471aa0f00599040b4c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:11.363424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.363563 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69a56-70be-4695-8e5e-ae5271acd3bb service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:11.368665 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:11.369460 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:11.369747 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:11.370086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] PATH_INFO: `/v3/users/60945ad51c2947579714d7aab3176a4b` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:11.370280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1391/2759] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:11.371231 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60945ad51c2947579714d7aab3176a4b)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:11.398311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:11.427641 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:11.430379 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.501486 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204ce9e-1124-4d2f-b8f1-3d407d85f0e5 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:11.504907 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91fdfcc74542409cb3c1b0ac2ea8c052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:11.505424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:11.505710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:11.506028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:11.508561 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.585541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:11.593575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60945ad51c2947579714d7aab3176a4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:11.610375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ace08-4d73-4284-af76-4e106d402b81 service glance] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:11.621415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1392/2760] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:28:11.695660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60945ad51c2947579714d7aab3176a4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:11.704009 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60945ad51c2947579714d7aab3176a4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:11.717606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60945ad51c2947579714d7aab3176a4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:11.718362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60945ad51c2947579714d7aab3176a4b'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:11.724214 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1369/2761] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:11 2022] DELETE /identity/v3/users/60945ad51c2947579714d7aab3176a4b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:11.729517 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:11.729819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:11.730144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:11.753487 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:11.754705 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.845728 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1393/2762] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:11.855765 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:11.857219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:11.929958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00747e6c-17b1-4e26-831b-ff33f908b669 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:11.933389 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:11.934004 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:11.934297 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:11.934584 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:11.946598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:11.972540 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:11.983081 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1370/2763] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:12.515629 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:12.517129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:12.529540 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b428-cc03-44b4-a8c7-9f3fd3ebc724 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:12.533144 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:12.533958 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:12.534346 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:12.534725 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:12.536511 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:12.642943 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:12.644969 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:12.658275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06705935-dbfa-44cb-9e2e-e659e0eade3e service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:12.664021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:12.665038 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:12.665511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:12.665686 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] PATH_INFO: `/v3/projects/683c9e4ef07c42d3a6f6807ff79625c3` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:12.667141 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683c9e4ef07c42d3a6f6807ff79625c3)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:12.693528 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:12.715218 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:12.741008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:12.752012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1394/2764] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:12 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:12.821615 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683c9e4ef07c42d3a6f6807ff79625c3', 'request_id': 'req-8846e21a-9c3f-4cec-86dc-edd80cbaac50'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:12.894911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683c9e4ef07c42d3a6f6807ff79625c3', 'request_id': 'req-8846e21a-9c3f-4cec-86dc-edd80cbaac50'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:12.907078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683c9e4ef07c42d3a6f6807ff79625c3', 'request_id': 'req-8846e21a-9c3f-4cec-86dc-edd80cbaac50'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:12.917883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] The token cache is being invalidate because project 683c9e4ef07c42d3a6f6807ff79625c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:12.918191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:12.918897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:12.920359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1371/2765] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:12 2022] DELETE /identity/v3/projects/683c9e4ef07c42d3a6f6807ff79625c3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:12.924710 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:12.936275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c439-c046-43f4-965c-c7b776ac4f7c service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:13.001312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:13.002156 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:13.002440 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:13.002719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] PATH_INFO: `/v3/users/3d3a34f6a8724b1d9cbc9643a38cc665` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:13.003800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3a34f6a8724b1d9cbc9643a38cc665)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:13.030254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:13.205920 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3a34f6a8724b1d9cbc9643a38cc665'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:13.215155 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3a34f6a8724b1d9cbc9643a38cc665'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:13.283248 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3a34f6a8724b1d9cbc9643a38cc665'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:13.300720 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3a34f6a8724b1d9cbc9643a38cc665'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:13.301398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aa1df6fe-2836-42e3-9205-4fb7bf88b9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3a34f6a8724b1d9cbc9643a38cc665'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:13.307680 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1395/2766] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:12 2022] DELETE /identity/v3/users/3d3a34f6a8724b1d9cbc9643a38cc665 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:13.833288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:13.837219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:13.854612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e21a-9c3f-4cec-86dc-edd80cbaac50 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:13.924064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:13.924899 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:13.925181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:13.925637 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] PATH_INFO: `/v3/projects/1e59f6e4a82444578e44d01622069604` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:13.926724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e59f6e4a82444578e44d01622069604)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:13.954248 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:14.073362 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e59f6e4a82444578e44d01622069604', 'request_id': 'req-e32e3905-5fcf-486e-b6e4-caa2513538a5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:14.146058 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e59f6e4a82444578e44d01622069604', 'request_id': 'req-e32e3905-5fcf-486e-b6e4-caa2513538a5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:14.159172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e59f6e4a82444578e44d01622069604', 'request_id': 'req-e32e3905-5fcf-486e-b6e4-caa2513538a5'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:14.169501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] The token cache is being invalidate because project 1e59f6e4a82444578e44d01622069604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:14.169781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:14.170415 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-e32e3905-5fcf-486e-b6e4-caa2513538a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:14.171934 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1372/2767] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:13 2022] DELETE /identity/v3/projects/1e59f6e4a82444578e44d01622069604 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:14.176904 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.177574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.177574 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.201662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:14.202933 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:14.270991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1396/2768] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:14.279470 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.279796 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.280113 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.305373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:14.306610 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:14.314380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1373/2769] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:14.319327 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:14.333095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5330-24e2-47f8-908e-ce5d220ff94e None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:14.333604 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:14.334707 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.335634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.335634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.335945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:28:14.336241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:14.361270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:14.374900 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1397/2770] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:28:14.379406 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:14.389317 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ba074-87ed-4184-9c79-cac803743f79 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:14.393543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:14.394159 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.394445 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.394726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.395349 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:14.421779 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:14.593529 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1374/2771] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:14 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:14.597646 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:14.607799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c2e8a-2b99-4731-b168-31029ba69e6b admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:14.675659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:14.675659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.675659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.675659 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.676261 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:14.702200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:14.798024 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1398/2772] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:14 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:14.802472 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:14.812864 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b279b0-a82c-46a5-94ac-b2ae580a1bc5 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:14.817320 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:14.817914 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.818232 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.819025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.820594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:14.847156 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50bee9-9bdf-4b93-aad7-41c393211000 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:14.861840 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1375/2773] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:14.863095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:14.878949 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a0ff-c530-44fc-b750-60259ddab327 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:14.884138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:14.885047 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:14.885404 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:14.885774 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] PATH_INFO: `/v3/projects/ac5943fddac64958bdb795059087eb4a/users/c7ff7480c8a64008ac0e934d4af2767e/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:14.908961 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5943fddac64958bdb795059087eb4a, user_id=c7ff7480c8a64008ac0e934d4af2767e, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:14.936172 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.041169 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1399/2774] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:14 2022] PUT /identity/v3/projects/ac5943fddac64958bdb795059087eb4a/users/c7ff7480c8a64008ac0e934d4af2767e/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:15.049533 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.049833 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.050322 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.091881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] MFA Rules not processed for user `c7ff7480c8a64008ac0e934d4af2767e`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:15.093959 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:15.180882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1376/2775] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:15.185337 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.264669 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1961-e1cb-4ea1-8020-7708018e1fb8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.269143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:15.269608 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.269892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.270204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.270842 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:15.298716 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.396525 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1400/2776] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:15 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:15.398275 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.409358 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3f72-4f56-4d0d-976e-a085880e0b28 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.473532 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:15.474182 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.474475 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.474787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.475938 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:15.501724 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.621487 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1377/2777] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:15 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:15.626489 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.637648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ab98f-a3cf-42e8-a013-20b6e4a032e2 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.641788 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:15.642403 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.642694 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.642973 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.643673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:15.669677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.682137 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1401/2778] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:15.686414 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.697155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925183-ddd2-4de0-9adb-23e3bcc9d68c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.701714 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:15.702653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.703005 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.703370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] PATH_INFO: `/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.725425 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9ef3c428a64980892831563dd0f37e, user_id=3c7941701f5e45138a127c1424859efc, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:15.752838 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.854417 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1378/2779] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:15 2022] PUT /identity/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:15.858397 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.868491 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062c8e-e1f0-43a9-85f0-cf56ac8d0078 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.932270 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:15.938036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:15.938036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:15.938036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:15.938036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:15.938380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.938380 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:15.961557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:15.972160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1402/2780] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:15.976551 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:15.986793 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dc8e8-ad37-419e-93b1-d0ad1ea9e1a8 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:15.993009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.000341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.000341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.000341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] PATH_INFO: `/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.000341 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9ef3c428a64980892831563dd0f37e, user_id=3c7941701f5e45138a127c1424859efc, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.010937 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a515-eac4-4f82-aba0-adad395c42ec admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:16.014746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.015334 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.015625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.015910 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.017566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:16.025531 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.029067 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.036226 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1403/2781] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:15 2022] PUT /identity/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:16.040618 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:16.054429 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.063519 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1379/2782] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:15 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:28:16.114101 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb40dd1-d3ea-42a1-8504-c38d362d5aa9 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:16.119594 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.120206 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.120506 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.120785 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.121484 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.146838 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260fb35-a22f-4275-9421-400a81498020 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.157662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1404/2783] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:16.163433 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:16.174526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304a2fb-678f-4c25-93a9-8fe37706a40c service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:16.181583 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.182558 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.182989 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.183323 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] PATH_INFO: `/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.185277 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9ef3c428a64980892831563dd0f37e, user_id=3c7941701f5e45138a127c1424859efc, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.213601 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.299709 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1380/2784] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:16 2022] PUT /identity/v3/projects/6a9ef3c428a64980892831563dd0f37e/users/3c7941701f5e45138a127c1424859efc/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:16.310332 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.310898 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.311008 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.349292 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] MFA Rules not processed for user `3c7941701f5e45138a127c1424859efc`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:16.350819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:16.431034 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1405/2785] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:16.441045 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:16.442674 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:16.512804 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131b90a-72a4-4e18-b9ce-60cd278ec842 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:16.516301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.516888 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.517183 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.517468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.526948 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.552618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.563600 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1381/2786] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:16.669693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:16.680437 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63007ba-f940-4a94-8b1d-c395fe095079 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:16.683779 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:16.684365 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:16.684634 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:16.684851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:16.750819 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:16.776684 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00864514-8669-4062-aed6-57aa0efa167e service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:16.786219 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1406/2787] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:20.124557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:20.195421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56775-59fe-4586-a88b-19eb29b69dad service cinder] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:20.199598 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:20.200395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:20.200726 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:20.201008 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] PATH_INFO: `/v3/users/c7ff7480c8a64008ac0e934d4af2767e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:20.202116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ff7480c8a64008ac0e934d4af2767e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:20.227631 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:20.433809 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ff7480c8a64008ac0e934d4af2767e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:20.505556 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ff7480c8a64008ac0e934d4af2767e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:20.514387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ff7480c8a64008ac0e934d4af2767e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:20.526221 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ff7480c8a64008ac0e934d4af2767e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:20.526849 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ff7480c8a64008ac0e934d4af2767e'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:20.532569 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1382/2788] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:20 2022] DELETE /identity/v3/users/c7ff7480c8a64008ac0e934d4af2767e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:20.537650 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:20.538212 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:20.538336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:20.561370 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:20.562543 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:20.628417 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1407/2789] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:20.639219 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:20.640634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:20.709617 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcb4fa-7f16-4c64-94b9-bc06eea5a5c3 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:20.713003 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:20.713594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:20.713881 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:20.714196 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:20.723567 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:20.750392 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:20.760494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1383/2790] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:21.346488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:21.348096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:21.364125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1971ab-da8b-495c-8cb0-74e1f4aba4fb None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:21.369768 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:21.370591 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:21.370880 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:21.371186 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] PATH_INFO: `/v3/projects/ac5943fddac64958bdb795059087eb4a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:21.372693 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5943fddac64958bdb795059087eb4a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:21.399160 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:21.489256 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5943fddac64958bdb795059087eb4a', 'request_id': 'req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.501200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5943fddac64958bdb795059087eb4a', 'request_id': 'req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.506572 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5943fddac64958bdb795059087eb4a', 'request_id': 'req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.579855 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] The token cache is being invalidate because project ac5943fddac64958bdb795059087eb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:21.580568 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.581129 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.582712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1408/2791] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:21 2022] DELETE /identity/v3/projects/ac5943fddac64958bdb795059087eb4a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:21.586841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:21.598977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd03e-8a6f-4a37-8390-36fb384ae936 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:21.672268 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:21.673084 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:21.673373 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:21.673654 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] PATH_INFO: `/v3/users/3c7941701f5e45138a127c1424859efc` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:21.674823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7941701f5e45138a127c1424859efc)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:21.701299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:21.913689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7941701f5e45138a127c1424859efc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:21.991634 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7941701f5e45138a127c1424859efc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.000511 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7941701f5e45138a127c1424859efc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.012301 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7941701f5e45138a127c1424859efc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.013037 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-53f5089f-7767-466b-9eec-9b5f94558bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7941701f5e45138a127c1424859efc'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.018877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1384/2792] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:28:21 2022] DELETE /identity/v3/users/3c7941701f5e45138a127c1424859efc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:22.617227 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:22.618626 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:22.635000 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa0c6-ec01-4a65-8a12-6db5c98cdf55 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:22.696193 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:22.696987 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:22.697271 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:22.697557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] PATH_INFO: `/v3/projects/6a9ef3c428a64980892831563dd0f37e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:22.698663 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9ef3c428a64980892831563dd0f37e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:22.724082 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:22.855624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9ef3c428a64980892831563dd0f37e', 'request_id': 'req-ccb40b5b-32db-4c4e-939e-97ffddefc538'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.867589 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9ef3c428a64980892831563dd0f37e', 'request_id': 'req-ccb40b5b-32db-4c4e-939e-97ffddefc538'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.872696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9ef3c428a64980892831563dd0f37e', 'request_id': 'req-ccb40b5b-32db-4c4e-939e-97ffddefc538'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.963759 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] The token cache is being invalidate because project 6a9ef3c428a64980892831563dd0f37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:28:22.964150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.964950 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ccb40b5b-32db-4c4e-939e-97ffddefc538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:28:22.972677 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1409/2793] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:28:22 2022] DELETE /identity/v3/projects/6a9ef3c428a64980892831563dd0f37e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:22.972822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:22.972822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:22.972822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:22.997359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:22.998679 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:23.064835 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1385/2794] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:23.073843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.074181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.074523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.098976 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:23.100828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:23.108932 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1410/2795] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:23.113359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.123468 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145cbed-e0dc-4919-a656-80011ba52cb7 None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.128047 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.128643 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.128935 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.129218 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] PATH_INFO: `/v3/domains` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.129916 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66751) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:28:23.130246 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:23.156143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:23.173235 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1386/2796] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:28:23.177598 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.186462 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22bfae-04b9-42e2-b037-fe391e46e9ba None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.191264 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.191851 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.192134 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.192415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] PATH_INFO: `/v3/projects` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.193041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:23.220138 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:23.330811 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1411/2797] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:23 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:23.335774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.346296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491735b2-5a3d-46e5-ac28-e71a4f82552e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.420401 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.421021 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.421471 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.421762 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] PATH_INFO: `/v3/users` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.422437 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:23.449870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:23.532390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1387/2798] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:23 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:23.533834 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.544843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdbabc-3d07-460d-9316-ee581d080267 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.549111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.549772 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.550142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.550424 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.551718 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:23.577802 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bd11-05b9-497b-b862-aae482e696d8 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:23.590124 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1412/2799] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:23.594230 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.604653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a2eb1-1f36-41b9-bc83-32bfa478474e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.609258 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.610128 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.610416 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.610680 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] PATH_INFO: `/v3/projects/809ef24228a24f46a00d287d0b0fa2cd/users/ea603af36e8b478f9ac1e1b99e806933/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.634143 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ef24228a24f46a00d287d0b0fa2cd, user_id=ea603af36e8b478f9ac1e1b99e806933, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:23.662388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:23.797390 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1388/2800] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:23 2022] PUT /identity/v3/projects/809ef24228a24f46a00d287d0b0fa2cd/users/ea603af36e8b478f9ac1e1b99e806933/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:23.802546 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ed4-ceb3-49f8-967b-b83b03516590 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.804104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ed4-ceb3-49f8-967b-b83b03516590 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.804104 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8ed4-ceb3-49f8-967b-b83b03516590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.825586 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-273e8ed4-ceb3-49f8-967b-b83b03516590 None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:23.826750 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-273e8ed4-ceb3-49f8-967b-b83b03516590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:23.895928 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1413/2801] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:23.906691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:23.908331 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:23.975477 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f945-c9cb-4355-8ea3-1b76aea8ba9e admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:23.978990 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:23.979575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:23.979862 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:23.980144 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:23.989167 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:24.016388 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:24.026419 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1389/2802] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:32.148719 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.149309 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.149449 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.186826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] MFA Rules not processed for user `ea603af36e8b478f9ac1e1b99e806933`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:32.187970 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:32.262798 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1414/2803] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:32.267200 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.277365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02525-aa82-48fd-af00-5ce492d0cbf6 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.281602 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.282201 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.282486 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.282764 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.283604 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.310841 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.387668 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1390/2804] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 10:28:32.391729 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.402603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41583a-a8ba-4794-842f-5817f0b680d2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.466211 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.466818 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.467179 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.467459 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.468096 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.494072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.597019 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1415/2805] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:28:32 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:28:32.601350 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.611694 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9b1f8-dbe3-4c0d-89f4-9751a6391382 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.616356 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.616952 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.617257 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.617525 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.618308 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.645484 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.657103 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1391/2806] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:32.661675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.671335 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cab03-0204-4b2c-af35-cf9768b481b1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.676037 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.676854 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.677565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.678046 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] PATH_INFO: `/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.699280 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321b70373b9540b889052132b085c73c, user_id=7d89d518d31849dab48f9d98364c2db1, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.726912 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.796050 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1416/2807] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:32 2022] PUT /identity/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:28:32.800012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.810543 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543105d-f26d-47c8-9473-5e511d6ecc59 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.875497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.876104 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.876387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.876666 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.877359 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.903092 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.914735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1392/2808] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:28:32.919141 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.929709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502f041-0cdc-4756-bdd6-2ba5a0198c04 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:32.933968 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:32.934803 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:32.935075 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:32.935354 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] PATH_INFO: `/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/2d75a104a2e84475b408c49f7034503e` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:32.937146 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] RBAC: Authorizing `identity:create_grant(project_id=321b70373b9540b889052132b085c73c, user_id=7d89d518d31849dab48f9d98364c2db1, role_id=2d75a104a2e84475b408c49f7034503e)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:32.963843 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7e30-ed58-44ac-ac51-ade5f04d904a admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:32.975850 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1417/2809] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:32 2022] PUT /identity/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/2d75a104a2e84475b408c49f7034503e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:32.979855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:32.989628 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c77f-77c0-4a2a-9737-9940b7634d4f admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:33.064646 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:33.065254 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:33.065542 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:33.065822 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:33.066715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:33.088363 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:33.088764 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:33.089125 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:33.093974 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:33.105114 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1393/2810] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 10:28:33.109051 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:33.114048 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] MFA Rules not processed for user `abab3646bda8471aa0f00599040b4c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:33.115917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:33.119494 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2d2f-7242-42c3-84f6-087f77eb329c admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:33.123992 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:33.124798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:33.125125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:33.125411 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] PATH_INFO: `/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:33.127198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=321b70373b9540b889052132b085c73c, user_id=7d89d518d31849dab48f9d98364c2db1, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:33.154168 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:33.179415 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1418/2811] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:28:33.245206 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1394/2812] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:28:33 2022] PUT /identity/v3/projects/321b70373b9540b889052132b085c73c/users/7d89d518d31849dab48f9d98364c2db1/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:28:33.663673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:33.743541 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31338-7428-49e2-85fc-c53fe5d35dd2 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:33.809436 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:33.810175 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:33.810529 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:33.810877 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:33.812769 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:33.827432 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:33.853776 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:33.863672 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1419/2813] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:34.412781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:34.414832 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:34.508900 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5bd1-3211-4ede-addc-0c0340864dcd admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:34.522572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:34.522572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:34.522572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:34.522572 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:34.522898 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:34.531758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:34.568333 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:34.579250 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1395/2814] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:34 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:34.695945 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:34.697442 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:34.712180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbd5e-76be-49dc-8f50-ff7f2505a4fa service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:34.716800 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:34.717612 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:34.718111 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:34.718409 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:34.721628 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:34.735361 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:34.763533 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a48fb-d7c9-4680-b1c2-5a28970e6a94 service placement] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:34.774700 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1420/2815] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:34 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:41.284630 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:41.286046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:41.375606 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7315c3b-8fbb-41dd-aa21-af85bf1a5a3f service placement] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:41.381626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:41.382264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:41.382559 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:41.382845 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:41.384609 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:41.397712 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:41.423387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:41.435007 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1396/2816] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:41 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:42.931368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca1d-15ec-48c7-aea6-3bb1b3f693cc None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:42.931882 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca1d-15ec-48c7-aea6-3bb1b3f693cc None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:42.931980 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca1d-15ec-48c7-aea6-3bb1b3f693cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:42.970356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-d158ca1d-15ec-48c7-aea6-3bb1b3f693cc None None] MFA Rules not processed for user `7d89d518d31849dab48f9d98364c2db1`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:42.971631 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d158ca1d-15ec-48c7-aea6-3bb1b3f693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:43.053991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1421/2817] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:43.065395 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:43.076119 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aef0c-981e-46d5-a511-ca4bf9fd392f service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:43.081116 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:43.081691 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:43.082014 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:43.082299 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:43.153421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:43.179575 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:43.188761 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1397/2818] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:28:46.556633 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3dba-03ae-46e3-854d-10fad64026a2 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:46.557254 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3dba-03ae-46e3-854d-10fad64026a2 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:46.557373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc3dba-03ae-46e3-854d-10fad64026a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:46.580017 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a6bc3dba-03ae-46e3-854d-10fad64026a2 None None] MFA Rules not processed for user `ea603af36e8b478f9ac1e1b99e806933`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:28:46.581167 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a6bc3dba-03ae-46e3-854d-10fad64026a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:46.590069 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1422/2819] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:28:47.385496 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:28:47.405269 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f9ff-90ba-4f59-91c2-8d1aaded5307 service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:28:47.413285 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:28:47.414106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:28:47.414497 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:28:47.414844 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:28:47.416808 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:28:47.432044 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:28:47.464046 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:28:47.478195 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1398/2820] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:28:47 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:29:02.799901 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb3fd-d7d6-4661-94e6-24644788bed6 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:02.800423 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb3fd-d7d6-4661-94e6-24644788bed6 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:02.800518 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb3fd-d7d6-4661-94e6-24644788bed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:02.825300 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-cd1eb3fd-d7d6-4661-94e6-24644788bed6 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:02.826522 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-cd1eb3fd-d7d6-4661-94e6-24644788bed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:02.893485 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1423/2821] 10.222.0.11 () {58 vars in 1014 bytes} [Wed Apr 6 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:29:03.017191 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:03.018660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:03.098660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76ca4-7249-42f0-8f52-e8a5cf6e06bf service nova] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:03.103501 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:03.104090 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:03.104374 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:03.104653 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:03.113140 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:03.140062 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:03.148920 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1399/2822] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 10:29:23.688114 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:23.688647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:23.688754 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:23.712536 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] MFA Rules not processed for user `b0f2d90de9d44b48a4d92f9380861ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:23.720414 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:23.721077 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1424/2823] 10.222.0.11 () {58 vars in 967 bytes} [Wed Apr 6 10:29:23 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:29:23.733986 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:23.744165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14847cf-d614-4545-9791-af4fbeb60d44 service swift] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:23.749042 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '050f0daf1aca4b498319ce5c265ec2b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:23.749618 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:23.749907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:23.750224 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:23.758859 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:23.784790 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:23.794181 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1400/2824] 10.222.0.11 () {60 vars in 1384 bytes} [Wed Apr 6 10:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 10:29:27.749496 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:27.751799 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:27.848041 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d82d-fcae-43b9-a34e-33bb76cb9243 None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:27.853569 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:27.859767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:27.859767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:27.859767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] PATH_INFO: `/v3/users/abab3646bda8471aa0f00599040b4c6b` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:27.859767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abab3646bda8471aa0f00599040b4c6b)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:27.882603 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:28.116917 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abab3646bda8471aa0f00599040b4c6b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.125655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abab3646bda8471aa0f00599040b4c6b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.212675 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abab3646bda8471aa0f00599040b4c6b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.228611 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abab3646bda8471aa0f00599040b4c6b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.229375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-ebb742e9-7cb2-4de4-9276-84d2f0f03e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abab3646bda8471aa0f00599040b4c6b'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.235648 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1425/2825] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:29:27 2022] DELETE /identity/v3/users/abab3646bda8471aa0f00599040b4c6b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:28.610951 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:28.638239 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de608ce-2845-4413-bbae-66bb6ba1706f service swift] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:28.717296 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:28.718165 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:28.718455 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:28.718737 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] PATH_INFO: `/v3/projects/cff1c7b959864eb5ad4223866a87d5c2` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:28.720012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff1c7b959864eb5ad4223866a87d5c2)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:28.746940 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:28.886870 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff1c7b959864eb5ad4223866a87d5c2', 'request_id': 'req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.961015 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff1c7b959864eb5ad4223866a87d5c2', 'request_id': 'req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.973735 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff1c7b959864eb5ad4223866a87d5c2', 'request_id': 'req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.984335 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] The token cache is being invalidate because project cff1c7b959864eb5ad4223866a87d5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:29:28.984625 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.985243 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-b586e3cc-0d33-43cf-9fa7-bc0d43c6a74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:28.986725 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1401/2826] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:29:28 2022] DELETE /identity/v3/projects/cff1c7b959864eb5ad4223866a87d5c2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 10:29:28.991632 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:28.998756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:28.998756 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.026787 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.auth.core [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66752) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:29.033028 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:29.095553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1426/2827] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:29:29.104292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.104589 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.104877 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.128652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:29.129801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:29.137121 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1402/2828] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:29:29.141411 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:29.151098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e82c76-6ede-411e-8efb-4dbaa288562a None None] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:29.155405 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:29.159375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.159375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.159375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.159375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66752) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 06 10:29:29.159375 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:29.183947 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:29.198429 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1427/2829] 10.222.0.11 () {58 vars in 1152 bytes} [Wed Apr 6 10:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 10:29:29.203025 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:29.213033 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013655-f554-43d9-b7cb-098c62e74bdd None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:29.217801 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:29.218413 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.218698 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.218975 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] PATH_INFO: `/v3/projects` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.219652 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:29.245094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:29.453907 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1403/2830] 10.222.0.11 () {60 vars in 1152 bytes} [Wed Apr 6 10:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:29:29.458200 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:29.471275 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e617e-af09-4963-9574-4c8ee0beaba7 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:29.548975 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:29.550894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.551635 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.552180 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.553547 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:29.600859 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:29.696294 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1428/2831] 10.222.0.11 () {60 vars in 1143 bytes} [Wed Apr 6 10:29:29 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 10:29:29.697079 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:29.707656 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab9472-0b5c-4719-91ed-da745d9a192d admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:29.712566 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:29.713166 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.713629 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.713911 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] PATH_INFO: `/v3/roles` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.714645 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:29.740839 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e6269-9579-4ccd-9511-59338916d69e admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:29.752294 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1404/2832] 10.222.0.11 () {58 vars in 1121 bytes} [Wed Apr 6 10:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 10:29:29.756559 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:29.768122 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400136-8f74-4a47-b6e3-7db8d32c5eb1 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:29.772336 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:29.773166 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] REQUEST_METHOD: `PUT` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.773682 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.774313 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] PATH_INFO: `/v3/projects/c1751b6b69f5492eb4c6a7ce9d37eb6e/users/80800c7a89b64d6bb4dcf4ac9c20d45f/roles/7a8ad31f1583471d86055e9e6f0ac142` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:29.797806 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1751b6b69f5492eb4c6a7ce9d37eb6e, user_id=80800c7a89b64d6bb4dcf4ac9c20d45f, role_id=7a8ad31f1583471d86055e9e6f0ac142)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:29.825514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:29.905107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1429/2833] 10.222.0.11 () {60 vars in 1482 bytes} [Wed Apr 6 10:29:29 2022] PUT /identity/v3/projects/c1751b6b69f5492eb4c6a7ce9d37eb6e/users/80800c7a89b64d6bb4dcf4ac9c20d45f/roles/7a8ad31f1583471d86055e9e6f0ac142 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:29.992270 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:29.993791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:29.994289 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:30.043070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] MFA Rules not processed for user `80800c7a89b64d6bb4dcf4ac9c20d45f`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:30.044513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:30.129763 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1405/2834] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 10:29:30.140749 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:30.142514 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:30.246036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a65809-00e0-447d-ad41-afca3fea5023 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:30.246036 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '125ce3f900a94e639c62b77d4f7d9c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:30.246742 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:30.247093 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:30.247373 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:30.260362 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:30.292347 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:30.302078 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1430/2835] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:29:30 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:29:30.645577 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:30.647017 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:30.724696 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb279bc-6150-493a-8793-66638ed3da8e None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:30.728787 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:30.729372 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:30.729667 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:30.730190 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:30.731885 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:30.826500 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:30.853451 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebab0b0-1185-45ca-bf9e-57e7cb4200ce service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:30.865125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1406/2836] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:29:30 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:29:33.751356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:33.823797 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484d503-3d00-4b4e-86ca-2c949a7143af service cinder] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:33.827993 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:33.828826 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:33.829130 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:33.829390 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] PATH_INFO: `/v3/users/80800c7a89b64d6bb4dcf4ac9c20d45f` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:33.830508 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80800c7a89b64d6bb4dcf4ac9c20d45f)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:33.857499 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:34.106590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80800c7a89b64d6bb4dcf4ac9c20d45f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:34.114647 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80800c7a89b64d6bb4dcf4ac9c20d45f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:34.177552 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80800c7a89b64d6bb4dcf4ac9c20d45f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:34.192005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80800c7a89b64d6bb4dcf4ac9c20d45f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:34.192894 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80800c7a89b64d6bb4dcf4ac9c20d45f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:34.200624 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1431/2837] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:29:33 2022] DELETE /identity/v3/users/80800c7a89b64d6bb4dcf4ac9c20d45f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:34.205233 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] REQUEST_METHOD: `POST` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:34.206399 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:34.206793 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:34.233523 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.auth.core [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] MFA Rules not processed for user `cf57ff3f8bf6405fb95452e508235caa`. Rule list: `[]` (Enabled: `True`). {{(pid=66751) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 10:29:34.234715 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:34.313396 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1407/2838] 10.222.0.11 () {58 vars in 957 bytes} [Wed Apr 6 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 10:29:34.324804 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:34.326320 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:34.394368 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97ee0-caf8-4987-8c74-bf04ce3ad5c4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:34.397662 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:34.398671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:34.398671 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:34.398966 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:34.409391 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:34.436269 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:34.446523 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1432/2839] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:29:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:29:35.081493 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:35.086131 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:35.159894 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a24096-a9c9-4de6-9317-997cc3eaf84a None None] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:35.166781 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:35.167582 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:35.167873 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:35.168155 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] PATH_INFO: `/v3/projects/c1751b6b69f5492eb4c6a7ce9d37eb6e` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:35.169264 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1751b6b69f5492eb4c6a7ce9d37eb6e)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:35.196160 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:35.346106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1751b6b69f5492eb4c6a7ce9d37eb6e', 'request_id': 'req-9dc97422-49ee-46cf-b183-bbb023818414'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:35.429912 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1751b6b69f5492eb4c6a7ce9d37eb6e', 'request_id': 'req-9dc97422-49ee-46cf-b183-bbb023818414'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:35.443172 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1751b6b69f5492eb4c6a7ce9d37eb6e', 'request_id': 'req-9dc97422-49ee-46cf-b183-bbb023818414'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:35.456186 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] The token cache is being invalidate because project c1751b6b69f5492eb4c6a7ce9d37eb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66751) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:29:35.456537 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:35.457288 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:35.458784 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1408/2840] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:29:35 2022] DELETE /identity/v3/projects/c1751b6b69f5492eb4c6a7ce9d37eb6e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:40.342088 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:40.364072 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8f64-e724-4d8c-ae96-4faed1edf5e5 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:40.424005 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:40.424590 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:40.424875 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:40.425150 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:40.426829 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:40.501018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:40.525732 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:40.536002 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1433/2841] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:29:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:29:54.053640 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:54.055926 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:54.070458 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97422-49ee-46cf-b183-bbb023818414 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:54.074977 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:54.075774 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:54.076070 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:54.076351 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] PATH_INFO: `/v3/users/af482d2941194468912f333c30e47d5f` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:54.077426 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af482d2941194468912f333c30e47d5f)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:54.103012 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:54.304137 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af482d2941194468912f333c30e47d5f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.371343 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af482d2941194468912f333c30e47d5f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.379895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af482d2941194468912f333c30e47d5f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.392526 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af482d2941194468912f333c30e47d5f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.393249 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af482d2941194468912f333c30e47d5f'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.399897 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1409/2842] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:29:54 2022] DELETE /identity/v3/users/af482d2941194468912f333c30e47d5f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:54.721170 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:54.734757 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b5bc5-082f-442b-a0e5-2e30fe787e3c service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:54.800809 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:54.801761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:54.802081 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:54.802355 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] PATH_INFO: `/v3/projects/b98b391176f2477ca4b1e374c8d12641` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:54.803478 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98b391176f2477ca4b1e374c8d12641)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:54.830018 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:54.951163 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98b391176f2477ca4b1e374c8d12641', 'request_id': 'req-d8763c36-14cb-4d47-b5a9-8611814e9c7f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.972655 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98b391176f2477ca4b1e374c8d12641', 'request_id': 'req-d8763c36-14cb-4d47-b5a9-8611814e9c7f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:54.979438 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98b391176f2477ca4b1e374c8d12641', 'request_id': 'req-d8763c36-14cb-4d47-b5a9-8611814e9c7f'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.062357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] The token cache is being invalidate because project b98b391176f2477ca4b1e374c8d12641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:29:55.062627 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.063312 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.064820 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1434/2843] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:29:54 2022] DELETE /identity/v3/projects/b98b391176f2477ca4b1e374c8d12641 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:55.068823 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:55.073826 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:55.083256 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65dc67-85bd-4e6f-9c8e-64d18017a116 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:55.149407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:55.150421 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:55.150704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:55.150980 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] PATH_INFO: `/v3/users/a7607ecf6d44409095d70255534f4b9a` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:55.152112 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7607ecf6d44409095d70255534f4b9a)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:55.178740 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:55.384513 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7607ecf6d44409095d70255534f4b9a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.445311 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7607ecf6d44409095d70255534f4b9a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.454050 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7607ecf6d44409095d70255534f4b9a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.466557 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7607ecf6d44409095d70255534f4b9a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.467198 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7607ecf6d44409095d70255534f4b9a'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:55.473125 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1410/2844] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:29:55 2022] DELETE /identity/v3/users/a7607ecf6d44409095d70255534f4b9a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:29:55.787692 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:29:55.789065 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:29:55.802384 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8763c36-14cb-4d47-b5a9-8611814e9c7f admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:29:55.869410 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:29:55.870162 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:29:55.870722 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:29:55.871066 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] PATH_INFO: `/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:29:55.872168 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d4a716ec9b4aec99add5bd5f50ec8a)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:29:55.897884 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:29:56.006012 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d4a716ec9b4aec99add5bd5f50ec8a', 'request_id': 'req-edce932c-b9b4-4036-8bec-359b04abb3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:56.018152 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d4a716ec9b4aec99add5bd5f50ec8a', 'request_id': 'req-edce932c-b9b4-4036-8bec-359b04abb3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:56.023233 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d4a716ec9b4aec99add5bd5f50ec8a', 'request_id': 'req-edce932c-b9b4-4036-8bec-359b04abb3b4'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:56.125488 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] The token cache is being invalidate because project d4d4a716ec9b4aec99add5bd5f50ec8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:29:56.125709 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:56.126288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:29:56.127761 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1435/2845] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:29:55 2022] DELETE /identity/v3/projects/d4d4a716ec9b4aec99add5bd5f50ec8a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:30:58.547057 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:30:58.548548 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:30:58.662138 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ff69-6d55-4d94-b0d5-7bd6572688eb admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:30:58.730278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:30:58.730278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:30:58.730278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:30:58.730278 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:30:58.732245 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:30:58.743703 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:30:58.769716 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:30:58.780958 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1411/2846] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:30:58 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:31:45.503185 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:31:45.506991 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:31:45.596202 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce932c-b9b4-4036-8bec-359b04abb3b4 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:31:45.600837 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:31:45.601425 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:31:45.601703 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:31:45.602009 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:31:45.603687 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:31:45.614767 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:31:45.641107 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:31:45.656266 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1436/2847] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:31:45 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:31:46.079175 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:31:46.088512 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e977b-4eaf-42d7-892e-5c0166f628ab service placement] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:31:46.093828 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:31:46.094453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:31:46.094746 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:31:46.095031 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:31:46.096745 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:31:46.108086 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:31:46.140807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:31:46.150355 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1412/2848] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:31:46 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:33:19.161696 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:19.163398 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:19.285571 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d429-9183-480e-b49e-33145b0e8777 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:19.291420 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be23285393b46bfb3a98e839c603cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:19.292015 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:19.292305 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:19.292602 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:19.294285 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:19.306773 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:19.331609 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:19.342790 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1437/2849] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:33:19.421078 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:19.430453 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e412319-8cb5-4236-b3bb-e8b0c5714e79 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:19.434234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:19.434883 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:19.435234 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:19.435612 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:19.437276 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:19.447882 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:19.473987 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:19.483292 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1413/2850] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 10:33:19.725453 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:19.736142 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fd64-aacb-49c3-be69-fe18bc149802 service nova] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:19.740450 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:19.741084 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:19.741376 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:19.741660 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:19.754070 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:19.783492 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:19.793828 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1438/2851] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:33:21.196791 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:21.198133 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:21.207967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7ffb-9039-48a6-9d7f-ee4f448162c8 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:21.211483 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:21.212394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:21.212394 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:21.212626 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:21.214226 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:21.227521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:21.254383 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:21.266515 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1414/2852] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:33:25.410147 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:25.420121 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834ce4-0d9b-4f6e-9f21-637bd7bd0087 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:25.423673 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c0d2de121404193950d51be23d2f57a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:25.424241 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] REQUEST_METHOD: `GET` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:25.424557 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:25.424840 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:25.426661 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:25.504666 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:25.535231 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:25.542515 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1439/2853] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 10:33:38.139594 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:38.140944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:38.155068 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f496b7-848a-4983-a42f-34d00e70b889 service neutron] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:38.159290 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:38.160094 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:38.160387 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:38.160672 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] PATH_INFO: `/v3/users/ea603af36e8b478f9ac1e1b99e806933` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:38.161758 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea603af36e8b478f9ac1e1b99e806933)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:38.188407 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:38.339521 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea603af36e8b478f9ac1e1b99e806933'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.423689 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea603af36e8b478f9ac1e1b99e806933'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.432336 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea603af36e8b478f9ac1e1b99e806933'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.444802 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea603af36e8b478f9ac1e1b99e806933'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.449704 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea603af36e8b478f9ac1e1b99e806933'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.451807 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1415/2854] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:33:38 2022] DELETE /identity/v3/users/ea603af36e8b478f9ac1e1b99e806933 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:33:38.756105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:38.767205 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685afef-a5e8-4643-b170-e2977f532284 service neutron] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:38.835357 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:38.836640 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:38.836926 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:38.837204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] PATH_INFO: `/v3/projects/809ef24228a24f46a00d287d0b0fa2cd` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:38.838356 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ef24228a24f46a00d287d0b0fa2cd)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:38.865143 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:38.967683 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ef24228a24f46a00d287d0b0fa2cd', 'request_id': 'req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.982095 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ef24228a24f46a00d287d0b0fa2cd', 'request_id': 'req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:38.988181 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ef24228a24f46a00d287d0b0fa2cd', 'request_id': 'req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.041105 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] The token cache is being invalidate because project 809ef24228a24f46a00d287d0b0fa2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:33:39.041481 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.042288 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.044098 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1440/2855] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:33:38 2022] DELETE /identity/v3/projects/809ef24228a24f46a00d287d0b0fa2cd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:33:39.048026 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:39.049444 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:39.062478 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aec19-6d2d-44b1-8ceb-0b1c6833cf99 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:39.128106 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:39.130365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:39.130365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:39.130365 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] PATH_INFO: `/v3/users/7d89d518d31849dab48f9d98364c2db1` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:39.130855 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d89d518d31849dab48f9d98364c2db1)` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:39.158504 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:39.299161 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d89d518d31849dab48f9d98364c2db1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.366344 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d89d518d31849dab48f9d98364c2db1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.374967 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d89d518d31849dab48f9d98364c2db1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.391170 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d89d518d31849dab48f9d98364c2db1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.391788 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.notifications [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d89d518d31849dab48f9d98364c2db1'} {{(pid=66751) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.398332 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1416/2856] 10.222.0.11 () {58 vars in 1223 bytes} [Wed Apr 6 10:33:39 2022] DELETE /identity/v3/users/7d89d518d31849dab48f9d98364c2db1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:33:39.724565 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Authenticating user token {{(pid=66752) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:33:39.725996 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.fernet_utils [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66752) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:33:39.738352 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e46b-c2e4-4e98-9d16-f7d384c8ae12 admin admin] Validating token access rules against request {{(pid=66752) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:33:39.802553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf57ff3f8bf6405fb95452e508235caa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '243059ad00e449c5acfc061092a4626d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66752) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:33:39.803353 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:33:39.804204 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:33:39.804712 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] PATH_INFO: `/v3/projects/321b70373b9540b889052132b085c73c` {{(pid=66752) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:33:39.805910 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=321b70373b9540b889052132b085c73c)` {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:33:39.831584 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] RBAC: Authorization granted {{(pid=66752) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:33:39.939304 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321b70373b9540b889052132b085c73c', 'request_id': 'req-e94b34ba-b585-4fe6-ad74-a50a7ded0995'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.953512 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321b70373b9540b889052132b085c73c', 'request_id': 'req-e94b34ba-b585-4fe6-ad74-a50a7ded0995'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:39.958892 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321b70373b9540b889052132b085c73c', 'request_id': 'req-e94b34ba-b585-4fe6-ad74-a50a7ded0995'} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:40.023267 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] The token cache is being invalidate because project 321b70373b9540b889052132b085c73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66752) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 10:33:40.023553 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:40.024157 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: DEBUG keystone.notifications [None req-e94b34ba-b585-4fe6-ad74-a50a7ded0995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66752) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 10:33:40.025579 dv-cinder-836753-1-iscsi devstack@keystone.service[66752]: [pid: 66752|app: 0|req: 1441/2857] 10.222.0.11 () {58 vars in 1232 bytes} [Wed Apr 6 10:33:39 2022] DELETE /identity/v3/projects/321b70373b9540b889052132b085c73c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 10:36:02.239064 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Authenticating user token {{(pid=66751) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 10:36:02.240393 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:36:02.315370 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eec36b-b2d1-4935-9622-e6cf9b5cbd30 admin admin] Validating token access rules against request {{(pid=66751) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 10:36:02.380207 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99c2c40c6d154576af32478a958db15e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69513349c8d54d8faaa11d039cee2c63', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66751) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 10:36:02.380798 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] REQUEST_METHOD: `GET` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 10:36:02.381660 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] SCRIPT_NAME: `/identity` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 10:36:02.381955 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66751) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 10:36:02.383622 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.fernet_utils [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66751) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 10:36:02.393895 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 06 10:36:02.419022 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24f1fc-9ce5-45d1-87a1-f6f483b950c7 service placement] RBAC: Authorization granted {{(pid=66751) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 10:36:02.428944 dv-cinder-836753-1-iscsi devstack@keystone.service[66751]: [pid: 66751|app: 0|req: 1417/2858] 10.222.0.11 () {60 vars in 1365 bytes} [Wed Apr 6 10:36:02 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)